Nov 14 22:03:23 user nova-compute[76815]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=76815) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 22:03:23 user nova-compute[76815]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=76815) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 22:03:23 user nova-compute[76815]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=76815) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 22:03:23 user nova-compute[76815]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 22:03:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:03:24 user nova-compute[76815]: INFO nova.virt.driver [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 22:03:24 user nova-compute[76815]: INFO nova.compute.provider_config [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] Acquiring lock "singleton_lock" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] Acquired lock "singleton_lock" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] Releasing lock "singleton_lock" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] Full set of CONF: {{(pid=76815) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ******************************************************************************** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] Configuration options gathered from: {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ================================================================================ {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] allow_resize_to_same_host      = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] arq_binding_timeout            = 300 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] backdoor_port                  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] backdoor_socket                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] block_device_allocate_retries  = 300 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] block_device_allocate_retries_interval = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cert                           = self.pem {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute_monitors               = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] config_dir                     = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] config_drive_format            = iso9660 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] config_source                  = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] console_host                   = user {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] control_exchange               = nova {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cpu_allocation_ratio           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] daemon                         = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] debug                          = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] default_access_ip_network_name = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] default_availability_zone      = nova {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] default_ephemeral_format       = ext4 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] default_green_pool_size        = 1000 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] default_schedule_zone          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] disk_allocation_ratio          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] enable_new_services            = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] enabled_apis                   = ['osapi_compute'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] enabled_ssl_apis               = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] flat_injected                  = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] force_config_drive             = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] force_raw_images               = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] graceful_shutdown_timeout      = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] heal_instance_info_cache_interval = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] host                           = user {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] instance_build_timeout         = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] instance_delete_interval       = 300 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] instance_name_template         = instance-%08x {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] instance_usage_audit           = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] instance_usage_audit_period    = month {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] internal_service_availability_zone = internal {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] key                            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] live_migration_retry_count     = 30 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] log_config_append              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] log_dir                        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] log_file                       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] log_options                    = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] log_rotate_interval            = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] log_rotate_interval_type       = days {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] log_rotation_type              = none {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] long_rpc_timeout               = 1800 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] max_concurrent_builds          = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] max_concurrent_live_migrations = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] max_concurrent_snapshots       = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] max_local_block_devices        = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] max_logfile_count              = 30 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] max_logfile_size_mb            = 200 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] maximum_instance_delete_attempts = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] metadata_listen                = 0.0.0.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] metadata_listen_port           = 8775 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] metadata_workers               = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] migrate_max_retries            = -1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] mkisofs_cmd                    = genisoimage {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] my_ip                          = 10.0.0.210 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] network_allocate_retries       = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] osapi_compute_listen_port      = 8774 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] osapi_compute_unique_server_name_scope =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] osapi_compute_workers          = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] password_length                = 12 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] periodic_enable                = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] periodic_fuzzy_delay           = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] pointer_model                  = ps2mouse {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] preallocate_images             = none {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] publish_errors                 = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] pybasedir                      = /opt/stack/nova {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ram_allocation_ratio           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] rate_limit_burst               = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] rate_limit_except_level        = CRITICAL {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] rate_limit_interval            = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] reboot_timeout                 = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] reclaim_instance_interval      = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] record                         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] reimage_timeout_per_gb         = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] report_interval                = 120 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] rescue_timeout                 = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] reserved_host_cpus             = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] reserved_host_disk_mb          = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] reserved_host_memory_mb        = 512 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] reserved_huge_pages            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] resize_confirm_window          = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] resize_fs_using_block_device   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] resume_guests_state_on_host_boot = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] rpc_response_timeout           = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] run_external_periodic_tasks    = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] running_deleted_instance_action = reap {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] running_deleted_instance_timeout = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler_instance_sync_interval = 120 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_down_time              = 720 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] servicegroup_driver            = db {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] shelved_offload_time           = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] shelved_poll_interval          = 3600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] shutdown_timeout               = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] source_is_ipv6                 = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ssl_only                       = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] state_path                     = /opt/stack/data/nova {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] sync_power_state_interval      = 600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] sync_power_state_pool_size     = 1000 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] syslog_log_facility            = LOG_USER {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] tempdir                        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] timeout_nbd                    = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] transport_url                  = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] update_resources_interval      = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] use_cow_images                 = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] use_eventlog                   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] use_journal                    = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] use_json                       = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] use_rootwrap_daemon            = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] use_stderr                     = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] use_syslog                     = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vcpu_pin_set                   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plugging_is_fatal          = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plugging_timeout           = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] virt_mkfs                      = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] volume_usage_poll_interval     = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] watch_log_file                 = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] web                            = /usr/share/spice-html5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_concurrency.disable_process_locking = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.auth_strategy              = keystone {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.compute_link_prefix        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.dhcp_domain                = novalocal {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.enable_instance_password   = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.glance_link_prefix         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.instance_list_per_project_cells = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.list_records_by_skipping_down_cells = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.local_metadata_per_cell    = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.max_limit                  = 1000 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.metadata_cache_expiration  = 15 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.neutron_default_tenant_id  = default {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.use_forwarded_for          = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.use_neutron_default_nets   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.vendordata_dynamic_targets = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.vendordata_jsonfile_path   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.backend                  = dogpile.cache.memcached {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.backend_argument         = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.config_prefix            = cache.oslo {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.dead_timeout             = 60.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.debug_cache_backend      = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.enable_retry_client      = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.enable_socket_keepalive  = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.enabled                  = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.expiration_time          = 600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.hashclient_retry_attempts = 2 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_dead_retry      = 300 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_password        =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_sasl_enabled    = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.memcache_username        =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.proxies                  = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.retry_attempts           = 2 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.retry_delay              = 0.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.socket_keepalive_count   = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.socket_keepalive_idle    = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.socket_keepalive_interval = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.tls_allowed_ciphers      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.tls_cafile               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.tls_certfile             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.tls_enabled              = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cache.tls_keyfile              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.auth_section            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.auth_type               = password {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.cafile                  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.certfile                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.collect_timing          = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.cross_az_attach         = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.debug                   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.endpoint_template       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.http_retries            = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.insecure                = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.keyfile                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.os_region_name          = RegionOne {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.split_loggers           = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cinder.timeout                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.cpu_dedicated_set      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.cpu_shared_set         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.image_type_exclude_list = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.resource_provider_association_refresh = 300 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.shutdown_retry_interval = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] conductor.workers              = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] console.allowed_origins        = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] console.ssl_ciphers            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] console.ssl_minimum_version    = default {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] consoleauth.token_ttl          = 600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.cafile                  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.certfile                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.collect_timing          = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.connect_retries         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.connect_retry_delay     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.endpoint_override       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.insecure                = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.keyfile                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.max_version             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.min_version             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.region_name             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.service_name            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.service_type            = accelerator {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.split_loggers           = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.status_code_retries     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.status_code_retry_delay = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.timeout                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] cyborg.version                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.backend               = sqlalchemy {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.connection            = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.connection_debug      = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.connection_parameters =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.connection_recycle_time = 3600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.connection_trace      = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.db_inc_retry_interval = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.db_max_retries        = 20 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.db_max_retry_interval = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.db_retry_interval     = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.max_overflow          = 50 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.max_pool_size         = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.max_retries           = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.mysql_wsrep_sync_wait = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.pool_timeout          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.retry_interval        = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.slave_connection      = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] database.sqlite_synchronous    = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.backend           = sqlalchemy {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.connection        = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.connection_debug  = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.connection_parameters =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.connection_recycle_time = 3600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.connection_trace  = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.db_inc_retry_interval = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.db_max_retries    = 20 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.db_max_retry_interval = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.db_retry_interval = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.max_overflow      = 50 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.max_pool_size     = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.max_retries       = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.pool_timeout      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.retry_interval    = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.slave_connection  = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] api_database.sqlite_synchronous = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] devices.enabled_mdev_types     = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ephemeral_storage_encryption.enabled = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.api_servers             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.cafile                  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.certfile                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.collect_timing          = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.connect_retries         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.connect_retry_delay     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.debug                   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.default_trusted_certificate_ids = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.enable_certificate_validation = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.enable_rbd_download     = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.endpoint_override       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.insecure                = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.keyfile                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.max_version             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.min_version             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.num_retries             = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.rbd_ceph_conf           =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.rbd_connect_timeout     = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.rbd_pool                =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.rbd_user                =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.region_name             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.service_name            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.service_type            = image {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.split_loggers           = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.status_code_retries     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.status_code_retry_delay = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.timeout                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.verify_glance_signatures = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] glance.version                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] guestfs.debug                  = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.config_drive_cdrom      = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.config_drive_inject_password = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.enable_instance_metrics_collection = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.enable_remotefx         = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.instances_path_share    =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.iscsi_initiator_list    = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.limit_cpu_features      = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.power_state_check_timeframe = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.use_multipath_io        = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.volume_attach_retry_count = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.vswitch_name            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] mks.enabled                    = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] image_cache.manager_interval   = 2400 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] image_cache.precache_concurrency = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] image_cache.remove_unused_base_images = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] image_cache.subdirectory_name  = _base {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.api_max_retries         = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.api_retry_interval      = 2 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.auth_section            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.auth_type               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.cafile                  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.certfile                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.collect_timing          = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.conductor_group         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.connect_retries         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.connect_retry_delay     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.endpoint_override       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.insecure                = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.keyfile                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.max_version             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.min_version             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.peer_list               = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.region_name             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.serial_console_state_timeout = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.service_name            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.service_type            = baremetal {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.split_loggers           = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.status_code_retries     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.status_code_retry_delay = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.timeout                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ironic.version                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] key_manager.fixed_key          = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.barbican_api_version  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.barbican_endpoint     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.barbican_endpoint_type = public {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.barbican_region_name  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.cafile                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.certfile              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.collect_timing        = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.insecure              = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.keyfile               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.number_of_retries     = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.retry_delay           = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.send_service_user_token = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.split_loggers         = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.timeout               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.verify_ssl            = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican.verify_ssl_path       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican_service_user.auth_section = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican_service_user.auth_type = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican_service_user.cafile   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican_service_user.certfile = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican_service_user.collect_timing = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican_service_user.insecure = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican_service_user.keyfile  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican_service_user.split_loggers = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] barbican_service_user.timeout  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.approle_role_id          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.approle_secret_id        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.cafile                   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.certfile                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.collect_timing           = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.insecure                 = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.keyfile                  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.kv_mountpoint            = secret {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.kv_path                  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.kv_version               = 2 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.namespace                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.root_token_id            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.split_loggers            = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.ssl_ca_crt_file          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.timeout                  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.use_ssl                  = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.auth_section          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.auth_type             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.cafile                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.certfile              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.collect_timing        = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.connect_retries       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.connect_retry_delay   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.endpoint_override     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.insecure              = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.keyfile               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.max_version           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.min_version           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.region_name           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.service_name          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.service_type          = identity {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.split_loggers         = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.status_code_retries   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.status_code_retry_delay = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.timeout               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] keystone.version               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.connection_uri         =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.cpu_mode               = custom {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: WARNING oslo_config.cfg [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.cpu_power_governor_high = performance {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.cpu_power_governor_low = powersave {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.cpu_power_management   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.device_detach_attempts = 8 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.device_detach_timeout  = 20 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.disk_cachemodes        = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.disk_prefix            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.enabled_perf_events    = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.file_backed_memory     = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.gid_maps               = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.hw_disk_discard        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.hw_machine_type        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.images_rbd_glance_store_name =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.images_rbd_pool        = rbd {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.images_type            = default {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.images_volume_group    = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.inject_key             = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.inject_partition       = -2 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.inject_password        = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.iscsi_iface            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.iser_use_multipath     = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_downtime = 500 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_inbound_addr = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_scheme  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_timeout_action = abort {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_tunnelled = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: WARNING oslo_config.cfg [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 22:03:24 user nova-compute[76815]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 22:03:24 user nova-compute[76815]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 22:03:24 user nova-compute[76815]: and ``live_migration_inbound_addr`` respectively.
Nov 14 22:03:24 user nova-compute[76815]: ).  Its value may be silently ignored in the future.
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.live_migration_with_native_tls = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.max_queues             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.nfs_mount_options      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.num_pcie_ports         = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.pmem_namespaces        = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.quobyte_client_cfg     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rbd_secret_uuid        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rbd_user               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rescue_image_id        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rescue_kernel_id       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rescue_ramdisk_id      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.rx_queue_size          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.smbfs_mount_options    =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.snapshot_compression   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.snapshot_image_format  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.sparse_logical_volumes = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.swtpm_enabled          = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.swtpm_group            = tss {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.swtpm_user             = tss {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.sysinfo_serial         = unique {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.tb_cache_size          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.tx_queue_size          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.uid_maps               = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.use_virtio_for_bridges = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.virt_type              = kvm {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.volume_clear           = zero {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.volume_clear_size      = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.volume_use_multipath   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.vzstorage_cache_path   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.vzstorage_mount_user   = stack {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.auth_section           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.auth_type              = password {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.cafile                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.certfile               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.collect_timing         = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.connect_retries        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.connect_retry_delay    = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.default_floating_pool  = public {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.endpoint_override      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.extension_sync_interval = 600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.http_retries           = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.insecure               = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.keyfile                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.max_version            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.min_version            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.ovs_bridge             = br-int {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.physnets               = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.region_name            = RegionOne {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.service_metadata_proxy = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.service_name           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.service_type           = network {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.split_loggers          = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.status_code_retries    = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.status_code_retry_delay = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.timeout                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] neutron.version                = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] notifications.bdms_in_notifications = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] notifications.default_level    = INFO {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] notifications.notification_format = unversioned {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] notifications.notify_on_state_change = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] pci.alias                      = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] pci.device_spec                = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] pci.report_in_placement        = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.auth_section         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.auth_type            = password {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.cafile               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.certfile             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.collect_timing       = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.connect_retries      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.connect_retry_delay  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.default_domain_id    = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.default_domain_name  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.domain_id            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.domain_name          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.endpoint_override    = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.insecure             = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.keyfile              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.max_version          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.min_version          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.password             = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.project_domain_id    = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.project_domain_name  = Default {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.project_id           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.project_name         = service {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.region_name          = RegionOne {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.service_name         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.service_type         = placement {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.split_loggers        = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.status_code_retries  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.status_code_retry_delay = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.system_scope         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.timeout              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.trust_id             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.user_domain_id       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.user_domain_name     = Default {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.user_id              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.username             = placement {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] placement.version              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.cores                    = 20 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.count_usage_from_placement = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.injected_file_content_bytes = 10240 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.injected_file_path_length = 255 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.injected_files           = 5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.instances                = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.key_pairs                = 100 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.metadata_items           = 128 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.ram                      = 51200 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.recheck_quota            = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.server_group_members     = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] quota.server_groups            = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] rdp.enabled                    = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.image_metadata_prefilter = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.max_attempts         = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.max_placement_results = 1000 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] scheduler.workers              = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.host_subset_size = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.isolated_hosts = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.isolated_images = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.pci_in_placement = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.track_instance_changes = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] metrics.required               = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] metrics.weight_multiplier      = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] metrics.weight_setting         = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] serial_console.enabled         = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] serial_console.port_range      = 10000:20000 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] serial_console.serialproxy_port = 6083 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.auth_section      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.auth_type         = password {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.cafile            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.certfile          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.collect_timing    = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.insecure          = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.keyfile           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.send_service_user_token = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.split_loggers     = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] service_user.timeout           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.agent_enabled            = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.enabled                  = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.html5proxy_port          = 6082 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.image_compression        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.jpeg_compression         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.playback_compression     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.server_listen            = 127.0.0.1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.streaming_mode           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] spice.zlib_compression         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] upgrade_levels.baseapi         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] upgrade_levels.cert            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] upgrade_levels.compute         = auto {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] upgrade_levels.conductor       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] upgrade_levels.scheduler       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vendordata_dynamic_auth.cafile = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vendordata_dynamic_auth.certfile = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vendordata_dynamic_auth.insecure = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vendordata_dynamic_auth.timeout = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.api_retry_count         = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.ca_file                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.cache_prefix            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.cluster_name            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.connection_pool_size    = 10 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.console_delay_seconds   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.datastore_regex         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.host_ip                 = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.host_password           = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.host_port               = 443 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.host_username           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.insecure                = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.integration_bridge      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.maximum_objects         = 100 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.pbm_default_policy      = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.pbm_enabled             = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.pbm_wsdl_location       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.serial_port_proxy_uri   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.serial_port_service_uri = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.task_poll_interval      = 0.5 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.use_linked_clone        = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.vnc_keymap              = en-us {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.vnc_port                = 5900 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vmware.vnc_port_total          = 10000 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.auth_schemes               = ['none'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.enabled                    = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.novncproxy_port            = 6080 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.server_listen              = 0.0.0.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.vencrypt_ca_certs          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.vencrypt_client_cert       = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vnc.vencrypt_client_key        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.disable_rootwrap   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.enable_numa_live_migration = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.libvirt_disable_apic = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.client_socket_timeout     = 900 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.default_pool_size         = 1000 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.keep_alive                = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.max_header_line           = 16384 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.ssl_ca_file               = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.ssl_cert_file             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.ssl_key_file              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.tcp_keepidle              = 600 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] zvm.ca_file                    = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] zvm.cloud_connector_url        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] zvm.reachable_timeout          = 300 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.enforce_new_defaults = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.enforce_scope      = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.policy_default_rule = default {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.connection_string     = messaging:// {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.enabled               = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.es_doc_type           = notification {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.es_scroll_size        = 10000 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.es_scroll_time        = 2m {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.filter_error_trace    = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.hmac_keys             = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.sentinel_service_name = mymaster {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.socket_timeout        = 0.1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.trace_requests        = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler.trace_sqlalchemy      = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler_jaeger.process_tags   = {} {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler_jaeger.service_name_prefix = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] profiler_otlp.service_name_prefix = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] remote_debug.host              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] remote_debug.port              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_notifications.retry = -1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.auth_section        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.auth_type           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.cafile              = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.certfile            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.collect_timing      = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.connect_retries     = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.connect_retry_delay = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.endpoint_id         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.endpoint_override   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.insecure            = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.keyfile             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.max_version         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.min_version         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.region_name         = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.service_name        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.service_type        = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.split_loggers       = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.status_code_retries = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.status_code_retry_delay = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.timeout             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.valid_interfaces    = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_limit.version             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_reports.file_event_handler = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] oslo_reports.log_dir           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_ovs_privileged.group  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] vif_plug_ovs_privileged.user   = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_linux_bridge.flat_interface = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_ovs.isolate_vif         = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_vif_ovs.per_port_bridge     = False {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] os_brick.lock_path             = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] privsep_osbrick.capabilities   = [21] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] privsep_osbrick.group          = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] privsep_osbrick.helper_command = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] privsep_osbrick.user           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] nova_sys_admin.group           = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] nova_sys_admin.helper_command  = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] nova_sys_admin.user            = None {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG oslo_service.service [None req-11a2ddbd-c607-42e9-a863-a01b90c45da5 None None] ******************************************************************************** {{(pid=76815) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 22:03:24 user nova-compute[76815]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 22:03:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Connecting to libvirt: qemu:///system {{(pid=76815) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f74d13a3040> {{(pid=76815) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 22:03:24 user nova-compute[76815]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 22:03:24 user nova-compute[76815]: WARNING nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 22:03:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f74d13a3040> {{(pid=76815) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Starting native event thread {{(pid=76815) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Starting green dispatch thread {{(pid=76815) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 22:03:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Starting connection event dispatch thread {{(pid=76815) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 22:03:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Connection event '1' reason 'None'
Nov 14 22:03:24 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 22:03:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.mount [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Initialising _HostMountState generation 0 {{(pid=76815) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 22:03:31 user nova-compute[76815]: INFO nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt host capabilities <capabilities>
Nov 14 22:03:31 user nova-compute[76815]:   <host>
Nov 14 22:03:31 user nova-compute[76815]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 22:03:31 user nova-compute[76815]:     <cpu>
Nov 14 22:03:31 user nova-compute[76815]:       <arch>x86_64</arch>
Nov 14 22:03:31 user nova-compute[76815]:       <model>IvyBridge-IBRS</model>
Nov 14 22:03:31 user nova-compute[76815]:       <vendor>Intel</vendor>
Nov 14 22:03:31 user nova-compute[76815]:       <microcode version='1070'/>
Nov 14 22:03:31 user nova-compute[76815]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 22:03:31 user nova-compute[76815]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='ss'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='vmx'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='pcid'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='osxsave'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='hypervisor'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='arat'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='tsc_adjust'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='md-clear'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='stibp'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='arch-capabilities'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='ssbd'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='invtsc'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='rsba'/>
Nov 14 22:03:31 user nova-compute[76815]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 22:03:31 user nova-compute[76815]:       <pages unit='KiB' size='4'/>
Nov 14 22:03:31 user nova-compute[76815]:       <pages unit='KiB' size='2048'/>
Nov 14 22:03:31 user nova-compute[76815]:     </cpu>
Nov 14 22:03:31 user nova-compute[76815]:     <power_management>
Nov 14 22:03:31 user nova-compute[76815]:       <suspend_mem/>
Nov 14 22:03:31 user nova-compute[76815]:       <suspend_disk/>
Nov 14 22:03:31 user nova-compute[76815]:       <suspend_hybrid/>
Nov 14 22:03:31 user nova-compute[76815]:     </power_management>
Nov 14 22:03:31 user nova-compute[76815]:     <iommu support='no'/>
Nov 14 22:03:31 user nova-compute[76815]:     <migration_features>
Nov 14 22:03:31 user nova-compute[76815]:       <live/>
Nov 14 22:03:31 user nova-compute[76815]:       <uri_transports>
Nov 14 22:03:31 user nova-compute[76815]:         <uri_transport>tcp</uri_transport>
Nov 14 22:03:31 user nova-compute[76815]:         <uri_transport>rdma</uri_transport>
Nov 14 22:03:31 user nova-compute[76815]:       </uri_transports>
Nov 14 22:03:31 user nova-compute[76815]:     </migration_features>
Nov 14 22:03:31 user nova-compute[76815]:     <topology>
Nov 14 22:03:31 user nova-compute[76815]:       <cells num='2'>
Nov 14 22:03:31 user nova-compute[76815]:         <cell id='0'>
Nov 14 22:03:31 user nova-compute[76815]:           <memory unit='KiB'>8189224</memory>
Nov 14 22:03:31 user nova-compute[76815]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 14 22:03:31 user nova-compute[76815]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 22:03:31 user nova-compute[76815]:           <distances>
Nov 14 22:03:31 user nova-compute[76815]:             <sibling id='0' value='10'/>
Nov 14 22:03:31 user nova-compute[76815]:             <sibling id='1' value='20'/>
Nov 14 22:03:31 user nova-compute[76815]:           </distances>
Nov 14 22:03:31 user nova-compute[76815]:           <cpus num='6'>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 22:03:31 user nova-compute[76815]:           </cpus>
Nov 14 22:03:31 user nova-compute[76815]:         </cell>
Nov 14 22:03:31 user nova-compute[76815]:         <cell id='1'>
Nov 14 22:03:31 user nova-compute[76815]:           <memory unit='KiB'>8206460</memory>
Nov 14 22:03:31 user nova-compute[76815]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 14 22:03:31 user nova-compute[76815]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 22:03:31 user nova-compute[76815]:           <distances>
Nov 14 22:03:31 user nova-compute[76815]:             <sibling id='0' value='20'/>
Nov 14 22:03:31 user nova-compute[76815]:             <sibling id='1' value='10'/>
Nov 14 22:03:31 user nova-compute[76815]:           </distances>
Nov 14 22:03:31 user nova-compute[76815]:           <cpus num='6'>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 22:03:31 user nova-compute[76815]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 22:03:31 user nova-compute[76815]:           </cpus>
Nov 14 22:03:31 user nova-compute[76815]:         </cell>
Nov 14 22:03:31 user nova-compute[76815]:       </cells>
Nov 14 22:03:31 user nova-compute[76815]:     </topology>
Nov 14 22:03:31 user nova-compute[76815]:     <cache>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 22:03:31 user nova-compute[76815]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 22:03:31 user nova-compute[76815]:     </cache>
Nov 14 22:03:31 user nova-compute[76815]:     <secmodel>
Nov 14 22:03:31 user nova-compute[76815]:       <model>apparmor</model>
Nov 14 22:03:31 user nova-compute[76815]:       <doi>0</doi>
Nov 14 22:03:31 user nova-compute[76815]:     </secmodel>
Nov 14 22:03:31 user nova-compute[76815]:     <secmodel>
Nov 14 22:03:31 user nova-compute[76815]:       <model>dac</model>
Nov 14 22:03:31 user nova-compute[76815]:       <doi>0</doi>
Nov 14 22:03:31 user nova-compute[76815]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 22:03:31 user nova-compute[76815]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 22:03:31 user nova-compute[76815]:     </secmodel>
Nov 14 22:03:31 user nova-compute[76815]:   </host>
Nov 14 22:03:31 user nova-compute[76815]:   <guest>
Nov 14 22:03:31 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:31 user nova-compute[76815]:     <arch name='alpha'>
Nov 14 22:03:31 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:31 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>clipper</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:31 user nova-compute[76815]:     </arch>
Nov 14 22:03:31 user nova-compute[76815]:     <features>
Nov 14 22:03:31 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:31 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:31 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:31 user nova-compute[76815]:     </features>
Nov 14 22:03:31 user nova-compute[76815]:   </guest>
Nov 14 22:03:31 user nova-compute[76815]:   <guest>
Nov 14 22:03:31 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:31 user nova-compute[76815]:     <arch name='armv6l'>
Nov 14 22:03:31 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:31 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>spitz</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>nuri</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>kzm</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>sx1</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>z2</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>tosa</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>n810</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>n800</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>terrier</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>midway</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>microbit</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>verdex</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='4'>highbank</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>akita</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>connex</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>collie</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:31 user nova-compute[76815]:     </arch>
Nov 14 22:03:31 user nova-compute[76815]:     <features>
Nov 14 22:03:31 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:31 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:31 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:31 user nova-compute[76815]:     </features>
Nov 14 22:03:31 user nova-compute[76815]:   </guest>
Nov 14 22:03:31 user nova-compute[76815]:   <guest>
Nov 14 22:03:31 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:31 user nova-compute[76815]:     <arch name='armv7l'>
Nov 14 22:03:31 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:31 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>spitz</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>nuri</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 22:03:31 user nova-compute[76815]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>kzm</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sx1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>z2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>tosa</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>n810</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>n800</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>terrier</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>midway</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>microbit</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>verdex</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>highbank</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>akita</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>connex</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>collie</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='aarch64'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>spitz</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>nuri</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>kzm</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sx1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>z2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>tosa</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>n810</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>n800</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>terrier</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>midway</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>microbit</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>verdex</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>highbank</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>akita</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>connex</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>collie</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <acpi default='on' toggle='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='cris'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='i686'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>isapc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>microvm</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='kvm'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <pae/>
Nov 14 22:03:32 user nova-compute[76815]:       <nonpae/>
Nov 14 22:03:32 user nova-compute[76815]:       <acpi default='on' toggle='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:       <apic default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='m68k'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>an5206</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>q800</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='microblaze'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='microblazeel'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='mips'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='16'>malta</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='mipsel'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='16'>malta</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='mips64'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='16'>malta</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>pica61</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>magnum</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='mips64el'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='16'>malta</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>pica61</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>magnum</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='16'>boston</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='ppc'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mac99</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>40p</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>taihu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='ppc64'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>taihu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>40p</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mac99</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='ppc64le'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>taihu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>40p</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>mac99</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='riscv32'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='8'>spike</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='8'>virt</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='riscv64'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='8'>spike</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='8'>virt</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='s390x'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='sh4'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>shix</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>r2d</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='sh4eb'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>shix</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>r2d</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='sparc'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>LX</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='sparc64'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>niagara</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='x86_64'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>64</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='1'>isapc</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>microvm</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='kvm'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <acpi default='on' toggle='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:       <apic default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='xtensa'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>sim</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>kc705</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>ml605</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>virt</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>lx200</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>lx60</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]:   <guest>
Nov 14 22:03:32 user nova-compute[76815]:     <os_type>hvm</os_type>
Nov 14 22:03:32 user nova-compute[76815]:     <arch name='xtensaeb'>
Nov 14 22:03:32 user nova-compute[76815]:       <wordsize>32</wordsize>
Nov 14 22:03:32 user nova-compute[76815]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='4'>sim</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>kc705</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>ml605</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>virt</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>lx200</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>lx60</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 22:03:32 user nova-compute[76815]:       <domain type='qemu'/>
Nov 14 22:03:32 user nova-compute[76815]:     </arch>
Nov 14 22:03:32 user nova-compute[76815]:     <features>
Nov 14 22:03:32 user nova-compute[76815]:       <cpuselection/>
Nov 14 22:03:32 user nova-compute[76815]:       <deviceboot/>
Nov 14 22:03:32 user nova-compute[76815]:       <disksnapshot default='on' toggle='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     </features>
Nov 14 22:03:32 user nova-compute[76815]:   </guest>
Nov 14 22:03:32 user nova-compute[76815]: </capabilities>
Nov 14 22:03:32 user nova-compute[76815]: 
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 22:03:32 user nova-compute[76815]: <domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 22:03:32 user nova-compute[76815]:   <domain>kvm</domain>
Nov 14 22:03:32 user nova-compute[76815]:   <machine>pc-q35-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:   <arch>i686</arch>
Nov 14 22:03:32 user nova-compute[76815]:   <vcpu max='288'/>
Nov 14 22:03:32 user nova-compute[76815]:   <iothreads supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:   <os supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='firmware'/>
Nov 14 22:03:32 user nova-compute[76815]:     <loader supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>rom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pflash</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='readonly'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='secure'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </loader>
Nov 14 22:03:32 user nova-compute[76815]:   </os>
Nov 14 22:03:32 user nova-compute[76815]:   <cpu>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-passthrough' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='hostPassthroughMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='maximum' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='maximumMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-model' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <vendor>Intel</vendor>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ss'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='vmx'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pcid'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='hypervisor'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arat'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='umip'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='md-clear'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibpb'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibrs'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='erms'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='lm'/>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='custom' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>qemu64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>qemu32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>phenom</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>n270</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>kvm64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>coreduo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>core2duo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>athlon</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Westmere</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Snowridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Penryn</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G5</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G4</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G1</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Nehalem</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Rome</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Milan</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Dhyana</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cooperlake</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Conroe</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>486</model>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:   </cpu>
Nov 14 22:03:32 user nova-compute[76815]:   <memoryBacking supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='sourceType'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>file</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>anonymous</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>memfd</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:   </memoryBacking>
Nov 14 22:03:32 user nova-compute[76815]:   <devices>
Nov 14 22:03:32 user nova-compute[76815]:     <disk supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='diskDevice'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>disk</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cdrom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>floppy</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>lun</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='bus'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>fdc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sata</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </disk>
Nov 14 22:03:32 user nova-compute[76815]:     <graphics supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sdl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vnc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>spice</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egl-headless</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </graphics>
Nov 14 22:03:32 user nova-compute[76815]:     <video supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='modelType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cirrus</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vmvga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>qxl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>none</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>bochs</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ramfb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </video>
Nov 14 22:03:32 user nova-compute[76815]:     <hostdev supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='mode'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>subsystem</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='startupPolicy'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>default</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>mandatory</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>requisite</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>optional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='subsysType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pci</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='capsType'/>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='pciBackend'/>
Nov 14 22:03:32 user nova-compute[76815]:     </hostdev>
Nov 14 22:03:32 user nova-compute[76815]:     <rng supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>random</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egd</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>builtin</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </rng>
Nov 14 22:03:32 user nova-compute[76815]:     <filesystem supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='driverType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>path</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>handle</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtiofs</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </filesystem>
Nov 14 22:03:32 user nova-compute[76815]:     <tpm supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-tis</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-crb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>passthrough</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>emulator</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </tpm>
Nov 14 22:03:32 user nova-compute[76815]:   </devices>
Nov 14 22:03:32 user nova-compute[76815]:   <features>
Nov 14 22:03:32 user nova-compute[76815]:     <gic supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     <vmcoreinfo supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <genid supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backingStoreInput supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backup supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <sev supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:   </features>
Nov 14 22:03:32 user nova-compute[76815]: </domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:  {{(pid=76815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 22:03:32 user nova-compute[76815]: <domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 22:03:32 user nova-compute[76815]:   <domain>kvm</domain>
Nov 14 22:03:32 user nova-compute[76815]:   <machine>pc-i440fx-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:   <arch>i686</arch>
Nov 14 22:03:32 user nova-compute[76815]:   <vcpu max='255'/>
Nov 14 22:03:32 user nova-compute[76815]:   <iothreads supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:   <os supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='firmware'/>
Nov 14 22:03:32 user nova-compute[76815]:     <loader supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>rom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pflash</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='readonly'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='secure'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </loader>
Nov 14 22:03:32 user nova-compute[76815]:   </os>
Nov 14 22:03:32 user nova-compute[76815]:   <cpu>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-passthrough' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='hostPassthroughMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='maximum' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='maximumMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-model' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <vendor>Intel</vendor>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ss'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='vmx'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pcid'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='hypervisor'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arat'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='umip'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='md-clear'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibpb'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibrs'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='erms'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='lm'/>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='custom' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>qemu64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>qemu32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>phenom</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>n270</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>kvm64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>coreduo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>core2duo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>athlon</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Westmere</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Snowridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Penryn</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G5</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G4</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G1</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Nehalem</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Rome</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Milan</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Dhyana</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cooperlake</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Conroe</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>486</model>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:   </cpu>
Nov 14 22:03:32 user nova-compute[76815]:   <memoryBacking supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='sourceType'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>file</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>anonymous</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>memfd</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:   </memoryBacking>
Nov 14 22:03:32 user nova-compute[76815]:   <devices>
Nov 14 22:03:32 user nova-compute[76815]:     <disk supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='diskDevice'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>disk</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cdrom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>floppy</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>lun</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='bus'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ide</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>fdc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sata</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </disk>
Nov 14 22:03:32 user nova-compute[76815]:     <graphics supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sdl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vnc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>spice</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egl-headless</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </graphics>
Nov 14 22:03:32 user nova-compute[76815]:     <video supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='modelType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cirrus</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vmvga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>qxl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>none</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>bochs</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ramfb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </video>
Nov 14 22:03:32 user nova-compute[76815]:     <hostdev supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='mode'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>subsystem</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='startupPolicy'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>default</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>mandatory</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>requisite</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>optional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='subsysType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pci</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='capsType'/>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='pciBackend'/>
Nov 14 22:03:32 user nova-compute[76815]:     </hostdev>
Nov 14 22:03:32 user nova-compute[76815]:     <rng supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>random</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egd</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>builtin</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </rng>
Nov 14 22:03:32 user nova-compute[76815]:     <filesystem supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='driverType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>path</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>handle</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtiofs</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </filesystem>
Nov 14 22:03:32 user nova-compute[76815]:     <tpm supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-tis</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-crb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>passthrough</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>emulator</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </tpm>
Nov 14 22:03:32 user nova-compute[76815]:   </devices>
Nov 14 22:03:32 user nova-compute[76815]:   <features>
Nov 14 22:03:32 user nova-compute[76815]:     <gic supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     <vmcoreinfo supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <genid supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backingStoreInput supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backup supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <sev supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:   </features>
Nov 14 22:03:32 user nova-compute[76815]: </domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:  {{(pid=76815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 22:03:32 user nova-compute[76815]: <domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 22:03:32 user nova-compute[76815]:   <domain>kvm</domain>
Nov 14 22:03:32 user nova-compute[76815]:   <machine>pc-i440fx-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:   <arch>i686</arch>
Nov 14 22:03:32 user nova-compute[76815]:   <vcpu max='255'/>
Nov 14 22:03:32 user nova-compute[76815]:   <iothreads supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:   <os supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='firmware'/>
Nov 14 22:03:32 user nova-compute[76815]:     <loader supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>rom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pflash</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='readonly'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='secure'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </loader>
Nov 14 22:03:32 user nova-compute[76815]:   </os>
Nov 14 22:03:32 user nova-compute[76815]:   <cpu>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-passthrough' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='hostPassthroughMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='maximum' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='maximumMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-model' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <vendor>Intel</vendor>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ss'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='vmx'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pcid'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='hypervisor'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arat'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='umip'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='md-clear'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibpb'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibrs'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='erms'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='lm'/>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='custom' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>qemu64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>qemu32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>phenom</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>n270</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>kvm64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>coreduo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>core2duo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>athlon</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Westmere</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Snowridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Penryn</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G5</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G4</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G1</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Nehalem</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Rome</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Milan</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Dhyana</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cooperlake</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Conroe</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>486</model>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:   </cpu>
Nov 14 22:03:32 user nova-compute[76815]:   <memoryBacking supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='sourceType'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>file</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>anonymous</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>memfd</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:   </memoryBacking>
Nov 14 22:03:32 user nova-compute[76815]:   <devices>
Nov 14 22:03:32 user nova-compute[76815]:     <disk supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='diskDevice'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>disk</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cdrom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>floppy</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>lun</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='bus'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ide</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>fdc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sata</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </disk>
Nov 14 22:03:32 user nova-compute[76815]:     <graphics supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sdl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vnc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>spice</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egl-headless</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </graphics>
Nov 14 22:03:32 user nova-compute[76815]:     <video supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='modelType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cirrus</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vmvga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>qxl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>none</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>bochs</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ramfb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </video>
Nov 14 22:03:32 user nova-compute[76815]:     <hostdev supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='mode'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>subsystem</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='startupPolicy'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>default</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>mandatory</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>requisite</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>optional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='subsysType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pci</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='capsType'/>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='pciBackend'/>
Nov 14 22:03:32 user nova-compute[76815]:     </hostdev>
Nov 14 22:03:32 user nova-compute[76815]:     <rng supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>random</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egd</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>builtin</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </rng>
Nov 14 22:03:32 user nova-compute[76815]:     <filesystem supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='driverType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>path</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>handle</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtiofs</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </filesystem>
Nov 14 22:03:32 user nova-compute[76815]:     <tpm supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-tis</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-crb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>passthrough</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>emulator</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </tpm>
Nov 14 22:03:32 user nova-compute[76815]:   </devices>
Nov 14 22:03:32 user nova-compute[76815]:   <features>
Nov 14 22:03:32 user nova-compute[76815]:     <gic supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     <vmcoreinfo supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <genid supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backingStoreInput supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backup supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <sev supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:   </features>
Nov 14 22:03:32 user nova-compute[76815]: </domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:  {{(pid=76815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 22:03:32 user nova-compute[76815]: <domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 22:03:32 user nova-compute[76815]:   <domain>kvm</domain>
Nov 14 22:03:32 user nova-compute[76815]:   <machine>pc-q35-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:   <arch>i686</arch>
Nov 14 22:03:32 user nova-compute[76815]:   <vcpu max='288'/>
Nov 14 22:03:32 user nova-compute[76815]:   <iothreads supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:   <os supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='firmware'/>
Nov 14 22:03:32 user nova-compute[76815]:     <loader supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>rom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pflash</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='readonly'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='secure'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </loader>
Nov 14 22:03:32 user nova-compute[76815]:   </os>
Nov 14 22:03:32 user nova-compute[76815]:   <cpu>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-passthrough' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='hostPassthroughMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='maximum' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='maximumMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-model' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <vendor>Intel</vendor>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ss'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='vmx'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pcid'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='hypervisor'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arat'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='umip'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='md-clear'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibpb'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibrs'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='erms'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='lm'/>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='custom' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>qemu64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>qemu32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>phenom</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>n270</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>kvm64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>coreduo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>core2duo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>athlon</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Westmere</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Snowridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Penryn</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G5</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G4</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G1</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Nehalem</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Rome</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Milan</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Dhyana</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cooperlake</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Conroe</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>486</model>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:   </cpu>
Nov 14 22:03:32 user nova-compute[76815]:   <memoryBacking supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='sourceType'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>file</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>anonymous</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>memfd</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:   </memoryBacking>
Nov 14 22:03:32 user nova-compute[76815]:   <devices>
Nov 14 22:03:32 user nova-compute[76815]:     <disk supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='diskDevice'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>disk</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cdrom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>floppy</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>lun</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='bus'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>fdc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sata</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </disk>
Nov 14 22:03:32 user nova-compute[76815]:     <graphics supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sdl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vnc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>spice</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egl-headless</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </graphics>
Nov 14 22:03:32 user nova-compute[76815]:     <video supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='modelType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cirrus</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vmvga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>qxl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>none</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>bochs</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ramfb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </video>
Nov 14 22:03:32 user nova-compute[76815]:     <hostdev supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='mode'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>subsystem</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='startupPolicy'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>default</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>mandatory</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>requisite</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>optional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='subsysType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pci</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='capsType'/>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='pciBackend'/>
Nov 14 22:03:32 user nova-compute[76815]:     </hostdev>
Nov 14 22:03:32 user nova-compute[76815]:     <rng supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>random</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egd</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>builtin</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </rng>
Nov 14 22:03:32 user nova-compute[76815]:     <filesystem supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='driverType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>path</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>handle</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtiofs</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </filesystem>
Nov 14 22:03:32 user nova-compute[76815]:     <tpm supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-tis</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-crb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>passthrough</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>emulator</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </tpm>
Nov 14 22:03:32 user nova-compute[76815]:   </devices>
Nov 14 22:03:32 user nova-compute[76815]:   <features>
Nov 14 22:03:32 user nova-compute[76815]:     <gic supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     <vmcoreinfo supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <genid supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backingStoreInput supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backup supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <sev supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:   </features>
Nov 14 22:03:32 user nova-compute[76815]: </domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:  {{(pid=76815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 22:03:32 user nova-compute[76815]: <domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 22:03:32 user nova-compute[76815]:   <domain>kvm</domain>
Nov 14 22:03:32 user nova-compute[76815]:   <machine>pc-q35-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:   <arch>x86_64</arch>
Nov 14 22:03:32 user nova-compute[76815]:   <vcpu max='288'/>
Nov 14 22:03:32 user nova-compute[76815]:   <iothreads supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:   <os supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='firmware'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>efi</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:     <loader supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>rom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pflash</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='readonly'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='secure'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </loader>
Nov 14 22:03:32 user nova-compute[76815]:   </os>
Nov 14 22:03:32 user nova-compute[76815]:   <cpu>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-passthrough' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='hostPassthroughMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='maximum' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='maximumMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-model' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <vendor>Intel</vendor>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ss'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='vmx'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pcid'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='hypervisor'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arat'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='umip'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='md-clear'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='invtsc'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibpb'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibrs'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='rsba'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='erms'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='custom' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>qemu64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>qemu32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>phenom</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>n270</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>coreduo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>core2duo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>athlon</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Westmere</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Snowridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Penryn</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G5</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G4</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Opteron_G1</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Nehalem</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Rome</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Milan</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Dhyana</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cooperlake</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Conroe</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>486</model>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:   </cpu>
Nov 14 22:03:32 user nova-compute[76815]:   <memoryBacking supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='sourceType'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>file</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>anonymous</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>memfd</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:   </memoryBacking>
Nov 14 22:03:32 user nova-compute[76815]:   <devices>
Nov 14 22:03:32 user nova-compute[76815]:     <disk supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='diskDevice'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>disk</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cdrom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>floppy</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>lun</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='bus'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>fdc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sata</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </disk>
Nov 14 22:03:32 user nova-compute[76815]:     <graphics supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sdl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vnc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>spice</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egl-headless</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </graphics>
Nov 14 22:03:32 user nova-compute[76815]:     <video supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='modelType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cirrus</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vmvga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>qxl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>none</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>bochs</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ramfb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </video>
Nov 14 22:03:32 user nova-compute[76815]:     <hostdev supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='mode'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>subsystem</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='startupPolicy'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>default</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>mandatory</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>requisite</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>optional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='subsysType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pci</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='capsType'/>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='pciBackend'/>
Nov 14 22:03:32 user nova-compute[76815]:     </hostdev>
Nov 14 22:03:32 user nova-compute[76815]:     <rng supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>random</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egd</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>builtin</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </rng>
Nov 14 22:03:32 user nova-compute[76815]:     <filesystem supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='driverType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>path</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>handle</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtiofs</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </filesystem>
Nov 14 22:03:32 user nova-compute[76815]:     <tpm supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-tis</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-crb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>passthrough</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>emulator</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </tpm>
Nov 14 22:03:32 user nova-compute[76815]:   </devices>
Nov 14 22:03:32 user nova-compute[76815]:   <features>
Nov 14 22:03:32 user nova-compute[76815]:     <gic supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     <vmcoreinfo supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <genid supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backingStoreInput supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backup supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <sev supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:   </features>
Nov 14 22:03:32 user nova-compute[76815]: </domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:  {{(pid=76815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 22:03:32 user nova-compute[76815]: <domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 22:03:32 user nova-compute[76815]:   <domain>kvm</domain>
Nov 14 22:03:32 user nova-compute[76815]:   <machine>pc-i440fx-jammy</machine>
Nov 14 22:03:32 user nova-compute[76815]:   <arch>x86_64</arch>
Nov 14 22:03:32 user nova-compute[76815]:   <vcpu max='255'/>
Nov 14 22:03:32 user nova-compute[76815]:   <iothreads supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:   <os supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='firmware'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>efi</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:     <loader supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>rom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pflash</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='readonly'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='secure'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </loader>
Nov 14 22:03:32 user nova-compute[76815]:   </os>
Nov 14 22:03:32 user nova-compute[76815]:   <cpu>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-passthrough' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='hostPassthroughMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='maximum' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='maximumMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-model' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <vendor>Intel</vendor>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ss'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='vmx'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pcid'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='hypervisor'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arat'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='umip'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='md-clear'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='invtsc'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibpb'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibrs'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='rsba'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='erms'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='custom' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>qemu64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>qemu32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>phenom</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>n270</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>coreduo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>core2duo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>athlon</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Westmere</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Snowridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Penryn</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G5</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G4</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Opteron_G1</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Nehalem</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Rome</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Milan</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Dhyana</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cooperlake</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Conroe</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>486</model>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:   </cpu>
Nov 14 22:03:32 user nova-compute[76815]:   <memoryBacking supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='sourceType'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>file</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>anonymous</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>memfd</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:   </memoryBacking>
Nov 14 22:03:32 user nova-compute[76815]:   <devices>
Nov 14 22:03:32 user nova-compute[76815]:     <disk supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='diskDevice'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>disk</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cdrom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>floppy</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>lun</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='bus'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ide</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>fdc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sata</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </disk>
Nov 14 22:03:32 user nova-compute[76815]:     <graphics supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sdl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vnc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>spice</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egl-headless</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </graphics>
Nov 14 22:03:32 user nova-compute[76815]:     <video supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='modelType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cirrus</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vmvga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>qxl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>none</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>bochs</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ramfb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </video>
Nov 14 22:03:32 user nova-compute[76815]:     <hostdev supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='mode'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>subsystem</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='startupPolicy'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>default</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>mandatory</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>requisite</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>optional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='subsysType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pci</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='capsType'/>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='pciBackend'/>
Nov 14 22:03:32 user nova-compute[76815]:     </hostdev>
Nov 14 22:03:32 user nova-compute[76815]:     <rng supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>random</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egd</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>builtin</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </rng>
Nov 14 22:03:32 user nova-compute[76815]:     <filesystem supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='driverType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>path</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>handle</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtiofs</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </filesystem>
Nov 14 22:03:32 user nova-compute[76815]:     <tpm supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-tis</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-crb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>passthrough</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>emulator</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </tpm>
Nov 14 22:03:32 user nova-compute[76815]:   </devices>
Nov 14 22:03:32 user nova-compute[76815]:   <features>
Nov 14 22:03:32 user nova-compute[76815]:     <gic supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     <vmcoreinfo supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <genid supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backingStoreInput supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backup supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <sev supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:   </features>
Nov 14 22:03:32 user nova-compute[76815]: </domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:  {{(pid=76815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 22:03:32 user nova-compute[76815]: <domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 22:03:32 user nova-compute[76815]:   <domain>kvm</domain>
Nov 14 22:03:32 user nova-compute[76815]:   <machine>pc-i440fx-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:   <arch>x86_64</arch>
Nov 14 22:03:32 user nova-compute[76815]:   <vcpu max='255'/>
Nov 14 22:03:32 user nova-compute[76815]:   <iothreads supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:   <os supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='firmware'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>efi</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:     <loader supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>rom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pflash</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='readonly'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='secure'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </loader>
Nov 14 22:03:32 user nova-compute[76815]:   </os>
Nov 14 22:03:32 user nova-compute[76815]:   <cpu>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-passthrough' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='hostPassthroughMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='maximum' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='maximumMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-model' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <vendor>Intel</vendor>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ss'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='vmx'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pcid'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='hypervisor'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arat'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='umip'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='md-clear'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='invtsc'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibpb'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibrs'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='rsba'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='erms'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='custom' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>qemu64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>qemu32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>phenom</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>n270</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>coreduo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>core2duo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>athlon</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Westmere</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Snowridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Penryn</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G5</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G4</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Opteron_G1</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Nehalem</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Rome</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Milan</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Dhyana</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cooperlake</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Conroe</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>486</model>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:   </cpu>
Nov 14 22:03:32 user nova-compute[76815]:   <memoryBacking supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='sourceType'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>file</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>anonymous</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>memfd</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:   </memoryBacking>
Nov 14 22:03:32 user nova-compute[76815]:   <devices>
Nov 14 22:03:32 user nova-compute[76815]:     <disk supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='diskDevice'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>disk</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cdrom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>floppy</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>lun</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='bus'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ide</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>fdc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sata</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </disk>
Nov 14 22:03:32 user nova-compute[76815]:     <graphics supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sdl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vnc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>spice</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egl-headless</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </graphics>
Nov 14 22:03:32 user nova-compute[76815]:     <video supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='modelType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cirrus</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vmvga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>qxl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>none</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>bochs</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ramfb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </video>
Nov 14 22:03:32 user nova-compute[76815]:     <hostdev supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='mode'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>subsystem</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='startupPolicy'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>default</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>mandatory</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>requisite</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>optional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='subsysType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pci</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='capsType'/>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='pciBackend'/>
Nov 14 22:03:32 user nova-compute[76815]:     </hostdev>
Nov 14 22:03:32 user nova-compute[76815]:     <rng supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>random</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egd</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>builtin</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </rng>
Nov 14 22:03:32 user nova-compute[76815]:     <filesystem supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='driverType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>path</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>handle</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtiofs</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </filesystem>
Nov 14 22:03:32 user nova-compute[76815]:     <tpm supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-tis</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-crb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>passthrough</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>emulator</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </tpm>
Nov 14 22:03:32 user nova-compute[76815]:   </devices>
Nov 14 22:03:32 user nova-compute[76815]:   <features>
Nov 14 22:03:32 user nova-compute[76815]:     <gic supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     <vmcoreinfo supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <genid supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backingStoreInput supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backup supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <sev supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:   </features>
Nov 14 22:03:32 user nova-compute[76815]: </domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:  {{(pid=76815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 22:03:32 user nova-compute[76815]: <domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 22:03:32 user nova-compute[76815]:   <domain>kvm</domain>
Nov 14 22:03:32 user nova-compute[76815]:   <machine>pc-q35-6.2</machine>
Nov 14 22:03:32 user nova-compute[76815]:   <arch>x86_64</arch>
Nov 14 22:03:32 user nova-compute[76815]:   <vcpu max='288'/>
Nov 14 22:03:32 user nova-compute[76815]:   <iothreads supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:   <os supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='firmware'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>efi</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:     <loader supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>rom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pflash</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='readonly'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='secure'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>yes</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>no</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </loader>
Nov 14 22:03:32 user nova-compute[76815]:   </os>
Nov 14 22:03:32 user nova-compute[76815]:   <cpu>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-passthrough' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='hostPassthroughMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='maximum' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='maximumMigratable'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>on</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>off</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='host-model' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <vendor>Intel</vendor>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ss'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='vmx'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pcid'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='hypervisor'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arat'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='umip'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='md-clear'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='invtsc'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibpb'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='ibrs'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-stibp'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='rsba'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='erms'/>
Nov 14 22:03:32 user nova-compute[76815]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:     <mode name='custom' supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>qemu64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>qemu32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>phenom</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>pentium</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>n270</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm64</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>kvm32</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>coreduo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>core2duo</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>athlon</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Westmere</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Snowridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Skylake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>SandyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Penryn</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G5</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G4</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G3</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Opteron_G2</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Opteron_G1</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Nehalem</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>IvyBridge</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Icelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Haswell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Rome</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-Milan</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>EPYC</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Dhyana</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cooperlake</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>Conroe</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='no'>Broadwell</model>
Nov 14 22:03:32 user nova-compute[76815]:       <model usable='yes'>486</model>
Nov 14 22:03:32 user nova-compute[76815]:     </mode>
Nov 14 22:03:32 user nova-compute[76815]:   </cpu>
Nov 14 22:03:32 user nova-compute[76815]:   <memoryBacking supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:     <enum name='sourceType'>
Nov 14 22:03:32 user nova-compute[76815]:       <value>file</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>anonymous</value>
Nov 14 22:03:32 user nova-compute[76815]:       <value>memfd</value>
Nov 14 22:03:32 user nova-compute[76815]:     </enum>
Nov 14 22:03:32 user nova-compute[76815]:   </memoryBacking>
Nov 14 22:03:32 user nova-compute[76815]:   <devices>
Nov 14 22:03:32 user nova-compute[76815]:     <disk supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='diskDevice'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>disk</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cdrom</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>floppy</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>lun</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='bus'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>fdc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sata</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </disk>
Nov 14 22:03:32 user nova-compute[76815]:     <graphics supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='type'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>sdl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vnc</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>spice</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egl-headless</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </graphics>
Nov 14 22:03:32 user nova-compute[76815]:     <video supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='modelType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>cirrus</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>vmvga</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>qxl</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>none</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>bochs</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>ramfb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </video>
Nov 14 22:03:32 user nova-compute[76815]:     <hostdev supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='mode'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>subsystem</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='startupPolicy'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>default</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>mandatory</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>requisite</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>optional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='subsysType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>usb</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>pci</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>scsi</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='capsType'/>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='pciBackend'/>
Nov 14 22:03:32 user nova-compute[76815]:     </hostdev>
Nov 14 22:03:32 user nova-compute[76815]:     <rng supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtio-non-transitional</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>random</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>egd</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>builtin</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </rng>
Nov 14 22:03:32 user nova-compute[76815]:     <filesystem supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='driverType'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>path</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>handle</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>virtiofs</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </filesystem>
Nov 14 22:03:32 user nova-compute[76815]:     <tpm supported='yes'>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='model'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-tis</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>tpm-crb</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:       <enum name='backendModel'>
Nov 14 22:03:32 user nova-compute[76815]:         <value>passthrough</value>
Nov 14 22:03:32 user nova-compute[76815]:         <value>emulator</value>
Nov 14 22:03:32 user nova-compute[76815]:       </enum>
Nov 14 22:03:32 user nova-compute[76815]:     </tpm>
Nov 14 22:03:32 user nova-compute[76815]:   </devices>
Nov 14 22:03:32 user nova-compute[76815]:   <features>
Nov 14 22:03:32 user nova-compute[76815]:     <gic supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:     <vmcoreinfo supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <genid supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backingStoreInput supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <backup supported='yes'/>
Nov 14 22:03:32 user nova-compute[76815]:     <sev supported='no'/>
Nov 14 22:03:32 user nova-compute[76815]:   </features>
Nov 14 22:03:32 user nova-compute[76815]: </domainCapabilities>
Nov 14 22:03:32 user nova-compute[76815]:  {{(pid=76815) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=76815) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=76815) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Checking secure boot support for host arch (x86_64) {{(pid=76815) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 22:03:32 user nova-compute[76815]: INFO nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Secure Boot support detected
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] cpu compare xml: <cpu match="exact">
Nov 14 22:03:32 user nova-compute[76815]:   <model>Nehalem</model>
Nov 14 22:03:32 user nova-compute[76815]: </cpu>
Nov 14 22:03:32 user nova-compute[76815]:  {{(pid=76815) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 22:03:32 user nova-compute[76815]: INFO nova.virt.node [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Generated node identity 796094e8-bd05-4653-ba99-df40d0b26085
Nov 14 22:03:32 user nova-compute[76815]: INFO nova.virt.node [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Wrote node identity 796094e8-bd05-4653-ba99-df40d0b26085 to /opt/stack/data/nova/compute_id
Nov 14 22:03:32 user nova-compute[76815]: WARNING nova.compute.manager [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Compute nodes ['796094e8-bd05-4653-ba99-df40d0b26085'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 22:03:32 user nova-compute[76815]: INFO nova.compute.manager [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 22:03:32 user nova-compute[76815]: WARNING nova.compute.manager [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 22:03:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:03:32 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:03:32 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Hypervisor/Node resource view: name=user free_ram=11001MB free_disk=26.085777282714844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:03:32 user nova-compute[76815]: WARNING nova.compute.resource_tracker [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] No compute node record for user:796094e8-bd05-4653-ba99-df40d0b26085: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 796094e8-bd05-4653-ba99-df40d0b26085 could not be found.
Nov 14 22:03:32 user nova-compute[76815]: INFO nova.compute.resource_tracker [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Compute node record created for user:user with uuid: 796094e8-bd05-4653-ba99-df40d0b26085
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:03:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:03:32 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] [req-8290cf68-7c1a-4b79-9d1d-c391f6fbecf1] Created resource provider record via placement API for resource provider with UUID 796094e8-bd05-4653-ba99-df40d0b26085 and name user.
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=76815) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 22:03:33 user nova-compute[76815]: INFO nova.virt.libvirt.host [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] kernel doesn't support AMD SEV
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Libvirt baseline CPU <cpu>
Nov 14 22:03:33 user nova-compute[76815]:   <arch>x86_64</arch>
Nov 14 22:03:33 user nova-compute[76815]:   <model>Nehalem</model>
Nov 14 22:03:33 user nova-compute[76815]:   <vendor>Intel</vendor>
Nov 14 22:03:33 user nova-compute[76815]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 22:03:33 user nova-compute[76815]: </cpu>
Nov 14 22:03:33 user nova-compute[76815]:  {{(pid=76815) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Updated inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Updating resource provider 796094e8-bd05-4653-ba99-df40d0b26085 generation from 0 to 1 during operation: update_inventory {{(pid=76815) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Updating resource provider 796094e8-bd05-4653-ba99-df40d0b26085 generation from 1 to 2 during operation: update_traits {{(pid=76815) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.service [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Creating RPC server for service compute {{(pid=76815) start /opt/stack/nova/nova/service.py:182}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.service [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] Join ServiceGroup membership for this service compute {{(pid=76815) start /opt/stack/nova/nova/service.py:199}}
Nov 14 22:03:33 user nova-compute[76815]: DEBUG nova.servicegroup.drivers.db [None req-915dc2a7-eaa5-4cb7-a826-97c6207d090d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=76815) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 22:04:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_power_states {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:04:24 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:04:24 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=10360MB free_disk=25.989540100097656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:04:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:05:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:05:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:05:26 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:05:26 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=10342MB free_disk=26.018802642822266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:05:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:06:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:06:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:06:26 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:06:26 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:06:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=10319MB free_disk=25.80630111694336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:06:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:06:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:06:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:06:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:06:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:06:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:06:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:07:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:07:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:07:27 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:07:27 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:07:27 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=9609MB free_disk=25.825927734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:07:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:07:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:07:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:07:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:29 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:07:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "bb235db0-61d3-4e29-9794-b7c181f074d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:07:36 user nova-compute[76815]: INFO nova.compute.claims [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Claim successful on node user
Nov 14 22:07:36 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG nova.network.neutron [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:07:36 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:07:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:07:36 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Creating image(s)
Nov 14 22:07:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "/opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "/opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:37 user nova-compute[76815]: DEBUG nova.policy [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '494ca9737a354c719f4b286053f7a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde13b6fb9174200aecd89b17c2b675e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:07:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b.part --force-share --output=json" returned: 0 in 0.217s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:37 user nova-compute[76815]: DEBUG nova.virt.images [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] 17f0b7df-7e07-48b3-bb67-6524172efa0a was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:07:37 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:07:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b.part /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b.part /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b.converted" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.893s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:37 user nova-compute[76815]: INFO oslo.privsep.daemon [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5vjzvnau/privsep.sock']
Nov 14 22:07:37 user sudo[86113]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5vjzvnau/privsep.sock
Nov 14 22:07:37 user sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 22:07:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:07:38 user nova-compute[76815]: INFO nova.compute.claims [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Claim successful on node user
Nov 14 22:07:38 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:07:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:07:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:07:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:07:38 user sudo[86113]: pam_unix(sudo:session): session closed for user root
Nov 14 22:07:38 user nova-compute[76815]: INFO oslo.privsep.daemon [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Spawned new privsep daemon via rootwrap
Nov 14 22:07:38 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 22:07:38 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 22:07:38 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 22:07:38 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86122
Nov 14 22:07:39 user nova-compute[76815]: DEBUG nova.policy [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c82120460b2945879455016ed97cafe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3021ff6fd9ad4958a9907c1b75f89a56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:07:39 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Creating image(s)
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "/opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "/opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.163s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk 1073741824" returned: 0 in 0.079s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.254s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk 1073741824" returned: 0 in 0.046s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Cannot resize image /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Ensure instance console log exists: /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Successfully created port: 0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:07:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:40 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Cannot resize image /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:07:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:07:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Ensure instance console log exists: /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:07:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:41 user nova-compute[76815]: DEBUG nova.network.neutron [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Successfully created port: 01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:07:42 user nova-compute[76815]: DEBUG nova.network.neutron [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Successfully updated port: 01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:07:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:07:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquired lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:07:42 user nova-compute[76815]: DEBUG nova.network.neutron [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:07:42 user nova-compute[76815]: DEBUG nova.network.neutron [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-37ef02c6-ccab-409a-92aa-dc9b873ef7d1 req-8420be35-01ad-412c-b759-dac769130154 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-changed-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-37ef02c6-ccab-409a-92aa-dc9b873ef7d1 req-8420be35-01ad-412c-b759-dac769130154 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Refreshing instance network info cache due to event network-changed-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37ef02c6-ccab-409a-92aa-dc9b873ef7d1 req-8420be35-01ad-412c-b759-dac769130154 service nova] Acquiring lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.network.neutron [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Releasing lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance network_info: |[{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37ef02c6-ccab-409a-92aa-dc9b873ef7d1 req-8420be35-01ad-412c-b759-dac769130154 service nova] Acquired lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.network.neutron [req-37ef02c6-ccab-409a-92aa-dc9b873ef7d1 req-8420be35-01ad-412c-b759-dac769130154 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Refreshing network info cache for port 01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Start _get_guest_xml network_info=[{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:07:43 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:07:43 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-740046946',display_name='tempest-ServerActionsTestOtherB-server-740046946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-740046946',id=2,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfyvibJFZ3+P9cPClSwRvADUm92jfJ8o6BTO5uqmymmHB851px3NqgPd2QQeHEC+IldkPYJsk/5QKXvtU1Q/t5lYj1GQkm68rGyQFBVBYEDC0MsPp+SZUuhpQDRtsF5Yw==',key_name='tempest-keypair-689678311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3021ff6fd9ad4958a9907c1b75f89a56',ramdisk_id='',reservation_id='r-uw1mr160',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-614422799',owner_user_name='tempest-ServerActionsTestOtherB-614422799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82120460b2945879455016ed97cafe9',uuid=2a7d6b8f-698f-4e0b-a28e-131121d8fe8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converting VIF {"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.objects.instance [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:07:43 user nova-compute[76815]:   <uuid>2a7d6b8f-698f-4e0b-a28e-131121d8fe8a</uuid>
Nov 14 22:07:43 user nova-compute[76815]:   <name>instance-00000002</name>
Nov 14 22:07:43 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:07:43 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:07:43 user nova-compute[76815]:   <metadata>
Nov 14 22:07:43 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:07:43 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:07:43 user nova-compute[76815]:       <nova:name>tempest-ServerActionsTestOtherB-server-740046946</nova:name>
Nov 14 22:07:43 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:07:43</nova:creationTime>
Nov 14 22:07:43 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:07:43 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:07:43 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:07:43 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:07:43 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:07:43 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:07:43 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:07:43 user nova-compute[76815]:       <nova:owner>
Nov 14 22:07:43 user nova-compute[76815]:         <nova:user uuid="c82120460b2945879455016ed97cafe9">tempest-ServerActionsTestOtherB-614422799-project-member</nova:user>
Nov 14 22:07:43 user nova-compute[76815]:         <nova:project uuid="3021ff6fd9ad4958a9907c1b75f89a56">tempest-ServerActionsTestOtherB-614422799</nova:project>
Nov 14 22:07:43 user nova-compute[76815]:       </nova:owner>
Nov 14 22:07:43 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:07:43 user nova-compute[76815]:       <nova:ports>
Nov 14 22:07:43 user nova-compute[76815]:         <nova:port uuid="01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae">
Nov 14 22:07:43 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 22:07:43 user nova-compute[76815]:         </nova:port>
Nov 14 22:07:43 user nova-compute[76815]:       </nova:ports>
Nov 14 22:07:43 user nova-compute[76815]:     </nova:instance>
Nov 14 22:07:43 user nova-compute[76815]:   </metadata>
Nov 14 22:07:43 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:07:43 user nova-compute[76815]:     <system>
Nov 14 22:07:43 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:07:43 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:07:43 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:07:43 user nova-compute[76815]:       <entry name="serial">2a7d6b8f-698f-4e0b-a28e-131121d8fe8a</entry>
Nov 14 22:07:43 user nova-compute[76815]:       <entry name="uuid">2a7d6b8f-698f-4e0b-a28e-131121d8fe8a</entry>
Nov 14 22:07:43 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:07:43 user nova-compute[76815]:     </system>
Nov 14 22:07:43 user nova-compute[76815]:   </sysinfo>
Nov 14 22:07:43 user nova-compute[76815]:   <os>
Nov 14 22:07:43 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:07:43 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:07:43 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:07:43 user nova-compute[76815]:   </os>
Nov 14 22:07:43 user nova-compute[76815]:   <features>
Nov 14 22:07:43 user nova-compute[76815]:     <acpi/>
Nov 14 22:07:43 user nova-compute[76815]:     <apic/>
Nov 14 22:07:43 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:07:43 user nova-compute[76815]:   </features>
Nov 14 22:07:43 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:07:43 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:07:43 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:07:43 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:07:43 user nova-compute[76815]:   </clock>
Nov 14 22:07:43 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:07:43 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:07:43 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:07:43 user nova-compute[76815]:   </cpu>
Nov 14 22:07:43 user nova-compute[76815]:   <devices>
Nov 14 22:07:43 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:07:43 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:07:43 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk"/>
Nov 14 22:07:43 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:07:43 user nova-compute[76815]:     </disk>
Nov 14 22:07:43 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:07:43 user nova-compute[76815]:       <mac address="fa:16:3e:33:73:f8"/>
Nov 14 22:07:43 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:07:43 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:07:43 user nova-compute[76815]:       <target dev="tap01b0d4dc-1d"/>
Nov 14 22:07:43 user nova-compute[76815]:     </interface>
Nov 14 22:07:43 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:07:43 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/console.log" append="off"/>
Nov 14 22:07:43 user nova-compute[76815]:     </serial>
Nov 14 22:07:43 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:07:43 user nova-compute[76815]:     <video>
Nov 14 22:07:43 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:07:43 user nova-compute[76815]:     </video>
Nov 14 22:07:43 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:07:43 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:07:43 user nova-compute[76815]:     </rng>
Nov 14 22:07:43 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:07:43 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:07:43 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:07:43 user nova-compute[76815]:     </memballoon>
Nov 14 22:07:43 user nova-compute[76815]:   </devices>
Nov 14 22:07:43 user nova-compute[76815]: </domain>
Nov 14 22:07:43 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-740046946',display_name='tempest-ServerActionsTestOtherB-server-740046946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-740046946',id=2,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfyvibJFZ3+P9cPClSwRvADUm92jfJ8o6BTO5uqmymmHB851px3NqgPd2QQeHEC+IldkPYJsk/5QKXvtU1Q/t5lYj1GQkm68rGyQFBVBYEDC0MsPp+SZUuhpQDRtsF5Yw==',key_name='tempest-keypair-689678311',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3021ff6fd9ad4958a9907c1b75f89a56',ramdisk_id='',reservation_id='r-uw1mr160',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-614422799',owner_user_name='tempest-ServerActionsTestOtherB-614422799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82120460b2945879455016ed97cafe9',uuid=2a7d6b8f-698f-4e0b-a28e-131121d8fe8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converting VIF {"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG os_vif [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Created schema index Interface.name {{(pid=76815) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Created schema index Port.name {{(pid=76815) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Created schema index Bridge.name {{(pid=76815) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [POLLOUT] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f4db374-c304-5fcf-a542-83069f7f61a7', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:07:43 user nova-compute[76815]: INFO oslo.privsep.daemon [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpijak9kwh/privsep.sock']
Nov 14 22:07:43 user sudo[86207]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpijak9kwh/privsep.sock
Nov 14 22:07:43 user sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 22:07:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Successfully updated port: 0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquired lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-bb84042a-a982-43a7-862f-23efa4498f07 req-f8e56776-fb9c-49de-bb6b-786fc5c5c2ce service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received event network-changed-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-bb84042a-a982-43a7-862f-23efa4498f07 req-f8e56776-fb9c-49de-bb6b-786fc5c5c2ce service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Refreshing instance network info cache due to event network-changed-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bb84042a-a982-43a7-862f-23efa4498f07 req-f8e56776-fb9c-49de-bb6b-786fc5c5c2ce service nova] Acquiring lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG nova.network.neutron [req-37ef02c6-ccab-409a-92aa-dc9b873ef7d1 req-8420be35-01ad-412c-b759-dac769130154 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updated VIF entry in instance network info cache for port 01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG nova.network.neutron [req-37ef02c6-ccab-409a-92aa-dc9b873ef7d1 req-8420be35-01ad-412c-b759-dac769130154 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37ef02c6-ccab-409a-92aa-dc9b873ef7d1 req-8420be35-01ad-412c-b759-dac769130154 service nova] Releasing lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:07:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Updating instance_info_cache with network_info: [{"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Releasing lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Instance network_info: |[{"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bb84042a-a982-43a7-862f-23efa4498f07 req-f8e56776-fb9c-49de-bb6b-786fc5c5c2ce service nova] Acquired lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-bb84042a-a982-43a7-862f-23efa4498f07 req-f8e56776-fb9c-49de-bb6b-786fc5c5c2ce service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Refreshing network info cache for port 0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Start _get_guest_xml network_info=[{"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:07:45 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:07:45 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-601697772',display_name='tempest-ServersNegativeTestJSON-server-601697772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-601697772',id=1,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bde13b6fb9174200aecd89b17c2b675e',ramdisk_id='',reservation_id='r-wcvfdz4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1003137324',owner_user_name='tempest-ServersNegativeTestJSON-1003137324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:37Z,user_data=None,user_id='494ca9737a354c719f4b286053f7a1b4',uuid=bb235db0-61d3-4e29-9794-b7c181f074d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converting VIF {"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:82:23,bridge_name='br-int',has_traffic_filtering=True,id=0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0a86c8-5a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.objects.instance [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lazy-loading 'pci_devices' on Instance uuid bb235db0-61d3-4e29-9794-b7c181f074d2 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:07:45 user nova-compute[76815]:   <uuid>bb235db0-61d3-4e29-9794-b7c181f074d2</uuid>
Nov 14 22:07:45 user nova-compute[76815]:   <name>instance-00000001</name>
Nov 14 22:07:45 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:07:45 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:07:45 user nova-compute[76815]:   <metadata>
Nov 14 22:07:45 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:07:45 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:07:45 user nova-compute[76815]:       <nova:name>tempest-ServersNegativeTestJSON-server-601697772</nova:name>
Nov 14 22:07:45 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:07:45</nova:creationTime>
Nov 14 22:07:45 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:07:45 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:07:45 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:07:45 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:07:45 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:07:45 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:07:45 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:07:45 user nova-compute[76815]:       <nova:owner>
Nov 14 22:07:45 user nova-compute[76815]:         <nova:user uuid="494ca9737a354c719f4b286053f7a1b4">tempest-ServersNegativeTestJSON-1003137324-project-member</nova:user>
Nov 14 22:07:45 user nova-compute[76815]:         <nova:project uuid="bde13b6fb9174200aecd89b17c2b675e">tempest-ServersNegativeTestJSON-1003137324</nova:project>
Nov 14 22:07:45 user nova-compute[76815]:       </nova:owner>
Nov 14 22:07:45 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:07:45 user nova-compute[76815]:       <nova:ports>
Nov 14 22:07:45 user nova-compute[76815]:         <nova:port uuid="0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9">
Nov 14 22:07:45 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 22:07:45 user nova-compute[76815]:         </nova:port>
Nov 14 22:07:45 user nova-compute[76815]:       </nova:ports>
Nov 14 22:07:45 user nova-compute[76815]:     </nova:instance>
Nov 14 22:07:45 user nova-compute[76815]:   </metadata>
Nov 14 22:07:45 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:07:45 user nova-compute[76815]:     <system>
Nov 14 22:07:45 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:07:45 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:07:45 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:07:45 user nova-compute[76815]:       <entry name="serial">bb235db0-61d3-4e29-9794-b7c181f074d2</entry>
Nov 14 22:07:45 user nova-compute[76815]:       <entry name="uuid">bb235db0-61d3-4e29-9794-b7c181f074d2</entry>
Nov 14 22:07:45 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:07:45 user nova-compute[76815]:     </system>
Nov 14 22:07:45 user nova-compute[76815]:   </sysinfo>
Nov 14 22:07:45 user nova-compute[76815]:   <os>
Nov 14 22:07:45 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:07:45 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:07:45 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:07:45 user nova-compute[76815]:   </os>
Nov 14 22:07:45 user nova-compute[76815]:   <features>
Nov 14 22:07:45 user nova-compute[76815]:     <acpi/>
Nov 14 22:07:45 user nova-compute[76815]:     <apic/>
Nov 14 22:07:45 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:07:45 user nova-compute[76815]:   </features>
Nov 14 22:07:45 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:07:45 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:07:45 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:07:45 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:07:45 user nova-compute[76815]:   </clock>
Nov 14 22:07:45 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:07:45 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:07:45 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:07:45 user nova-compute[76815]:   </cpu>
Nov 14 22:07:45 user nova-compute[76815]:   <devices>
Nov 14 22:07:45 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:07:45 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:07:45 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk"/>
Nov 14 22:07:45 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:07:45 user nova-compute[76815]:     </disk>
Nov 14 22:07:45 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:07:45 user nova-compute[76815]:       <mac address="fa:16:3e:c4:82:23"/>
Nov 14 22:07:45 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:07:45 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:07:45 user nova-compute[76815]:       <target dev="tap0c0a86c8-5a"/>
Nov 14 22:07:45 user nova-compute[76815]:     </interface>
Nov 14 22:07:45 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:07:45 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/console.log" append="off"/>
Nov 14 22:07:45 user nova-compute[76815]:     </serial>
Nov 14 22:07:45 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:07:45 user nova-compute[76815]:     <video>
Nov 14 22:07:45 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:07:45 user nova-compute[76815]:     </video>
Nov 14 22:07:45 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:07:45 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:07:45 user nova-compute[76815]:     </rng>
Nov 14 22:07:45 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:07:45 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:07:45 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:07:45 user nova-compute[76815]:     </memballoon>
Nov 14 22:07:45 user nova-compute[76815]:   </devices>
Nov 14 22:07:45 user nova-compute[76815]: </domain>
Nov 14 22:07:45 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-601697772',display_name='tempest-ServersNegativeTestJSON-server-601697772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-601697772',id=1,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bde13b6fb9174200aecd89b17c2b675e',ramdisk_id='',reservation_id='r-wcvfdz4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1003137324',owner_user_name='tempest-ServersNegativeTestJSON-1003137324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:37Z,user_data=None,user_id='494ca9737a354c719f4b286053f7a1b4',uuid=bb235db0-61d3-4e29-9794-b7c181f074d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converting VIF {"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:82:23,bridge_name='br-int',has_traffic_filtering=True,id=0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0a86c8-5a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG os_vif [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:82:23,bridge_name='br-int',has_traffic_filtering=True,id=0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0a86c8-5a') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05cea942-3287-564b-842b-47275333f302', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:07:45 user sudo[86207]: pam_unix(sudo:session): session closed for user root
Nov 14 22:07:45 user nova-compute[76815]: INFO oslo.privsep.daemon [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Spawned new privsep daemon via rootwrap
Nov 14 22:07:45 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 22:07:45 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 22:07:45 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 22:07:45 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86217
Nov 14 22:07:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:45 user nova-compute[76815]: WARNING oslo_privsep.priv_context [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] privsep daemon already running
Nov 14 22:07:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b0d4dc-1d, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01b0d4dc-1d, col_values=(('qos', UUID('9faf599c-79ae-4794-9c71-bcd0f6ae910a')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01b0d4dc-1d, col_values=(('external_ids', {'iface-id': '01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:73:f8', 'vm-uuid': '2a7d6b8f-698f-4e0b-a28e-131121d8fe8a'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:46 user nova-compute[76815]: INFO os_vif [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d')
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c0a86c8-5a, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c0a86c8-5a, col_values=(('qos', UUID('ee3b8a54-2929-4c24-bd96-df991050de6d')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c0a86c8-5a, col_values=(('external_ids', {'iface-id': '0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:82:23', 'vm-uuid': 'bb235db0-61d3-4e29-9794-b7c181f074d2'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:46 user nova-compute[76815]: INFO os_vif [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:82:23,bridge_name='br-int',has_traffic_filtering=True,id=0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0a86c8-5a')
Nov 14 22:07:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] No VIF found with MAC fa:16:3e:33:73:f8, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] No VIF found with MAC fa:16:3e:c4:82:23, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-bb84042a-a982-43a7-862f-23efa4498f07 req-f8e56776-fb9c-49de-bb6b-786fc5c5c2ce service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Updated VIF entry in instance network info cache for port 0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-bb84042a-a982-43a7-862f-23efa4498f07 req-f8e56776-fb9c-49de-bb6b-786fc5c5c2ce service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Updating instance_info_cache with network_info: [{"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:07:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bb84042a-a982-43a7-862f-23efa4498f07 req-f8e56776-fb9c-49de-bb6b-786fc5c5c2ce service nova] Releasing lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:07:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance spawned successfully.
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:07:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Instance spawned successfully.
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:07:51 user nova-compute[76815]: INFO nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Took 14.73 seconds to spawn the instance on the hypervisor.
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:07:51 user nova-compute[76815]: INFO nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Took 12.32 seconds to spawn the instance on the hypervisor.
Nov 14 22:07:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:07:51 user nova-compute[76815]: INFO nova.compute.manager [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Took 13.03 seconds to build instance.
Nov 14 22:07:51 user nova-compute[76815]: INFO nova.compute.manager [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Took 15.71 seconds to build instance.
Nov 14 22:07:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2ba70fd-8706-4079-885a-3d33834803e9 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.234s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49a8a683-5405-4d72-a9f4-3bb532f7b5a8 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.949s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:52 user nova-compute[76815]: DEBUG nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:07:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:52 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:07:52 user nova-compute[76815]: INFO nova.compute.claims [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Claim successful on node user
Nov 14 22:07:53 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG nova.network.neutron [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:07:53 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:07:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG nova.policy [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '187becfe77604b6d9b4d7f2e8826631d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd89e0ce8ea4637b1f83034d9264bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:07:53 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Creating image(s)
Nov 14 22:07:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "/opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "/opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.333s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.270s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk 1073741824" returned: 0 in 0.053s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.222s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Cannot resize image /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Ensure instance console log exists: /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:55 user nova-compute[76815]: DEBUG nova.network.neutron [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Successfully created port: 26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:07:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:07:56 user nova-compute[76815]: INFO nova.compute.claims [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Claim successful on node user
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.network.neutron [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Successfully updated port: 26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquired lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.network.neutron [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-d610e96b-896e-41bc-ba52-11652072bf82 req-dacd69a2-18ea-46ca-8304-a1ee51584ba6 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received event network-changed-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-d610e96b-896e-41bc-ba52-11652072bf82 req-dacd69a2-18ea-46ca-8304-a1ee51584ba6 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Refreshing instance network info cache due to event network-changed-26a0eb02-82ba-4263-899f-9d49359e9dd5. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d610e96b-896e-41bc-ba52-11652072bf82 req-dacd69a2-18ea-46ca-8304-a1ee51584ba6 service nova] Acquiring lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.network.neutron [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "16c58923-c97e-4148-af31-9609b9af5d80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:07:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.041s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:07:57 user nova-compute[76815]: INFO nova.compute.claims [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Claim successful on node user
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:07:57 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.network.neutron [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Updating instance_info_cache with network_info: [{"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Releasing lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Instance network_info: |[{"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d610e96b-896e-41bc-ba52-11652072bf82 req-dacd69a2-18ea-46ca-8304-a1ee51584ba6 service nova] Acquired lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.network.neutron [req-d610e96b-896e-41bc-ba52-11652072bf82 req-dacd69a2-18ea-46ca-8304-a1ee51584ba6 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Refreshing network info cache for port 26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Start _get_guest_xml network_info=[{"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.policy [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6851a124ff8e4fe6a08810a8b257eff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d468f624a3d4526ab4422c7a1bea2f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:57 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:07:57 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:07:57 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Creating image(s)
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "/opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "/opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "/opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1152007292',display_name='tempest-VolumesAdminNegativeTest-server-1152007292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1152007292',id=3,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4JOZYnesMO0NW56EQswzCqpOxK07w+5wYCSkn1GESIYuqAKqN9bHEIj7HYRHLf+C8SrfHdZyqdUV+i7WRQfMsUczvAawHUChtJBeA1YQrYbPEuG1fKQcuXkVCT9LlFUg==',key_name='tempest-keypair-1851957661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acd89e0ce8ea4637b1f83034d9264bf6',ramdisk_id='',reservation_id='r-wxqsmsrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77219795',owner_user_name='tempest-VolumesAdminNegativeTest-77219795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187becfe77604b6d9b4d7f2e8826631d',uuid=a3ba0d7d-48dd-4718-9447-fb632bd1e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converting VIF {"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:6f:fe,bridge_name='br-int',has_traffic_filtering=True,id=26a0eb02-82ba-4263-899f-9d49359e9dd5,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a0eb02-82') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.objects.instance [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lazy-loading 'pci_devices' on Instance uuid a3ba0d7d-48dd-4718-9447-fb632bd1e57b {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:07:57 user nova-compute[76815]:   <uuid>a3ba0d7d-48dd-4718-9447-fb632bd1e57b</uuid>
Nov 14 22:07:57 user nova-compute[76815]:   <name>instance-00000003</name>
Nov 14 22:07:57 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:07:57 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:07:57 user nova-compute[76815]:   <metadata>
Nov 14 22:07:57 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:07:57 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:07:57 user nova-compute[76815]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1152007292</nova:name>
Nov 14 22:07:57 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:07:57</nova:creationTime>
Nov 14 22:07:57 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:07:57 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:07:57 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:07:57 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:07:57 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:07:57 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:07:57 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:07:57 user nova-compute[76815]:       <nova:owner>
Nov 14 22:07:57 user nova-compute[76815]:         <nova:user uuid="187becfe77604b6d9b4d7f2e8826631d">tempest-VolumesAdminNegativeTest-77219795-project-member</nova:user>
Nov 14 22:07:57 user nova-compute[76815]:         <nova:project uuid="acd89e0ce8ea4637b1f83034d9264bf6">tempest-VolumesAdminNegativeTest-77219795</nova:project>
Nov 14 22:07:57 user nova-compute[76815]:       </nova:owner>
Nov 14 22:07:57 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:07:57 user nova-compute[76815]:       <nova:ports>
Nov 14 22:07:57 user nova-compute[76815]:         <nova:port uuid="26a0eb02-82ba-4263-899f-9d49359e9dd5">
Nov 14 22:07:57 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 22:07:57 user nova-compute[76815]:         </nova:port>
Nov 14 22:07:57 user nova-compute[76815]:       </nova:ports>
Nov 14 22:07:57 user nova-compute[76815]:     </nova:instance>
Nov 14 22:07:57 user nova-compute[76815]:   </metadata>
Nov 14 22:07:57 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:07:57 user nova-compute[76815]:     <system>
Nov 14 22:07:57 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:07:57 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:07:57 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:07:57 user nova-compute[76815]:       <entry name="serial">a3ba0d7d-48dd-4718-9447-fb632bd1e57b</entry>
Nov 14 22:07:57 user nova-compute[76815]:       <entry name="uuid">a3ba0d7d-48dd-4718-9447-fb632bd1e57b</entry>
Nov 14 22:07:57 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:07:57 user nova-compute[76815]:     </system>
Nov 14 22:07:57 user nova-compute[76815]:   </sysinfo>
Nov 14 22:07:57 user nova-compute[76815]:   <os>
Nov 14 22:07:57 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:07:57 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:07:57 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:07:57 user nova-compute[76815]:   </os>
Nov 14 22:07:57 user nova-compute[76815]:   <features>
Nov 14 22:07:57 user nova-compute[76815]:     <acpi/>
Nov 14 22:07:57 user nova-compute[76815]:     <apic/>
Nov 14 22:07:57 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:07:57 user nova-compute[76815]:   </features>
Nov 14 22:07:57 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:07:57 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:07:57 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:07:57 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:07:57 user nova-compute[76815]:   </clock>
Nov 14 22:07:57 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:07:57 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:07:57 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:07:57 user nova-compute[76815]:   </cpu>
Nov 14 22:07:57 user nova-compute[76815]:   <devices>
Nov 14 22:07:57 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:07:57 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:07:57 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk"/>
Nov 14 22:07:57 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:07:57 user nova-compute[76815]:     </disk>
Nov 14 22:07:57 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:07:57 user nova-compute[76815]:       <mac address="fa:16:3e:16:6f:fe"/>
Nov 14 22:07:57 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:07:57 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:07:57 user nova-compute[76815]:       <target dev="tap26a0eb02-82"/>
Nov 14 22:07:57 user nova-compute[76815]:     </interface>
Nov 14 22:07:57 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:07:57 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/console.log" append="off"/>
Nov 14 22:07:57 user nova-compute[76815]:     </serial>
Nov 14 22:07:57 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:07:57 user nova-compute[76815]:     <video>
Nov 14 22:07:57 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:07:57 user nova-compute[76815]:     </video>
Nov 14 22:07:57 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:07:57 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:07:57 user nova-compute[76815]:     </rng>
Nov 14 22:07:57 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:07:57 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:07:57 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:07:57 user nova-compute[76815]:     </memballoon>
Nov 14 22:07:57 user nova-compute[76815]:   </devices>
Nov 14 22:07:57 user nova-compute[76815]: </domain>
Nov 14 22:07:57 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1152007292',display_name='tempest-VolumesAdminNegativeTest-server-1152007292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1152007292',id=3,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4JOZYnesMO0NW56EQswzCqpOxK07w+5wYCSkn1GESIYuqAKqN9bHEIj7HYRHLf+C8SrfHdZyqdUV+i7WRQfMsUczvAawHUChtJBeA1YQrYbPEuG1fKQcuXkVCT9LlFUg==',key_name='tempest-keypair-1851957661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acd89e0ce8ea4637b1f83034d9264bf6',ramdisk_id='',reservation_id='r-wxqsmsrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77219795',owner_user_name='tempest-VolumesAdminNegativeTest-77219795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187becfe77604b6d9b4d7f2e8826631d',uuid=a3ba0d7d-48dd-4718-9447-fb632bd1e57b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converting VIF {"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:6f:fe,bridge_name='br-int',has_traffic_filtering=True,id=26a0eb02-82ba-4263-899f-9d49359e9dd5,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a0eb02-82') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG os_vif [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:6f:fe,bridge_name='br-int',has_traffic_filtering=True,id=26a0eb02-82ba-4263-899f-9d49359e9dd5,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a0eb02-82') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce16c4d2-849d-54f2-8fe7-1f091207cf57', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26a0eb02-82, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26a0eb02-82, col_values=(('qos', UUID('f6301e89-6fd9-4169-8e91-48f26e3842a0')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26a0eb02-82, col_values=(('external_ids', {'iface-id': '26a0eb02-82ba-4263-899f-9d49359e9dd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:6f:fe', 'vm-uuid': 'a3ba0d7d-48dd-4718-9447-fb632bd1e57b'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:07:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:57 user nova-compute[76815]: INFO os_vif [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:6f:fe,bridge_name='br-int',has_traffic_filtering=True,id=26a0eb02-82ba-4263-899f-9d49359e9dd5,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a0eb02-82')
Nov 14 22:07:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] No VIF found with MAC fa:16:3e:16:6f:fe, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c.part --force-share --output=json" returned: 0 in 0.279s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.virt.images [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] 67d3cd1b-dcdc-4323-9b14-42851ba967c5 was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c.part /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.219s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c.part /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c.converted" returned: 0 in 0.401s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:07:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Successfully created port: 620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:07:58 user nova-compute[76815]: INFO nova.virt.block_device [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Booting with volume 0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 at /dev/vda
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.policy [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51594092be7f40638e43426bf32e5290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73af2afa50e415d85402bbea4bb143a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.network.neutron [req-d610e96b-896e-41bc-ba52-11652072bf82 req-dacd69a2-18ea-46ca-8304-a1ee51584ba6 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Updated VIF entry in instance network info cache for port 26a0eb02-82ba-4263-899f-9d49359e9dd5. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG nova.network.neutron [req-d610e96b-896e-41bc-ba52-11652072bf82 req-dacd69a2-18ea-46ca-8304-a1ee51584ba6 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Updating instance_info_cache with network_info: [{"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d610e96b-896e-41bc-ba52-11652072bf82 req-dacd69a2-18ea-46ca-8304-a1ee51584ba6 service nova] Releasing lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c.converted --force-share --output=json" returned: 0 in 0.351s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.595s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG os_brick.utils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:07:59 user nova-compute[76815]: INFO oslo.privsep.daemon [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpt2m8tp8u/privsep.sock']
Nov 14 22:07:59 user sudo[86568]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpt2m8tp8u/privsep.sock
Nov 14 22:07:59 user sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c --force-share --output=json" returned: 0 in 0.280s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c --force-share --output=json" returned: 0 in 0.270s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c,backing_fmt=raw /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c,backing_fmt=raw /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk 1073741824" returned: 0 in 0.084s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Successfully updated port: 620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "refresh_cache-2629c515-bd23-4df8-bdfc-4e84c0c06e5a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquired lock "refresh_cache-2629c515-bd23-4df8-bdfc-4e84c0c06e5a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c --force-share --output=json" returned: 0 in 0.327s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:07:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-7143d6ce-bebd-4fe1-9599-c51e4bdf879c req-8ffc7e75-d012-4190-85b8-3f871453504a service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received event network-vif-plugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7143d6ce-bebd-4fe1-9599-c51e4bdf879c req-8ffc7e75-d012-4190-85b8-3f871453504a service nova] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7143d6ce-bebd-4fe1-9599-c51e4bdf879c req-8ffc7e75-d012-4190-85b8-3f871453504a service nova] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7143d6ce-bebd-4fe1-9599-c51e4bdf879c req-8ffc7e75-d012-4190-85b8-3f871453504a service nova] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-7143d6ce-bebd-4fe1-9599-c51e4bdf879c req-8ffc7e75-d012-4190-85b8-3f871453504a service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] No waiting events found dispatching network-vif-plugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:00 user nova-compute[76815]: WARNING nova.compute.manager [req-7143d6ce-bebd-4fe1-9599-c51e4bdf879c req-8ffc7e75-d012-4190-85b8-3f871453504a service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received unexpected event network-vif-plugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 for instance with vm_state building and task_state spawning.
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-3039bbb8-1876-4f1c-8850-5410ad367083 req-a0b8481b-3993-4966-9f00-b5ae612a27c1 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received event network-changed-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-3039bbb8-1876-4f1c-8850-5410ad367083 req-a0b8481b-3993-4966-9f00-b5ae612a27c1 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Refreshing instance network info cache due to event network-changed-620ab99e-0aa9-4b39-9963-dc38976df1f4. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3039bbb8-1876-4f1c-8850-5410ad367083 req-a0b8481b-3993-4966-9f00-b5ae612a27c1 service nova] Acquiring lock "refresh_cache-2629c515-bd23-4df8-bdfc-4e84c0c06e5a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:08:00 user nova-compute[76815]: INFO nova.compute.claims [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Claim successful on node user
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Cannot resize image /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Ensure instance console log exists: /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:08:00 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:08:00 user nova-compute[76815]: DEBUG nova.policy [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3356e497cd5243beb1e6d5aa0b24a177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f304c47366c4cd1af23a1f0d43d8825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:08:01 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Creating image(s)
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Updating instance_info_cache with network_info: [{"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.network.neutron [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Successfully created port: 46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Releasing lock "refresh_cache-2629c515-bd23-4df8-bdfc-4e84c0c06e5a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Instance network_info: |[{"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3039bbb8-1876-4f1c-8850-5410ad367083 req-a0b8481b-3993-4966-9f00-b5ae612a27c1 service nova] Acquired lock "refresh_cache-2629c515-bd23-4df8-bdfc-4e84c0c06e5a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.network.neutron [req-3039bbb8-1876-4f1c-8850-5410ad367083 req-a0b8481b-3993-4966-9f00-b5ae612a27c1 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Refreshing network info cache for port 620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Start _get_guest_xml network_info=[{"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:07:47Z,direct_url=<?>,disk_format='qcow2',id=67d3cd1b-dcdc-4323-9b14-42851ba967c5,min_disk=0,min_ram=0,name='',owner='ace8e6a6327e4e4c9c06ec3b2a776535',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:07:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'disk_bus': 'scsi', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '67d3cd1b-dcdc-4323-9b14-42851ba967c5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:08:01 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:01 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:01 user sudo[86568]: pam_unix(sudo:session): session closed for user root
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:07:47Z,direct_url=<?>,disk_format='qcow2',id=67d3cd1b-dcdc-4323-9b14-42851ba967c5,min_disk=0,min_ram=0,name='',owner='ace8e6a6327e4e4c9c06ec3b2a776535',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:07:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-692357177',display_name='tempest-AttachSCSIVolumeTestJSON-server-692357177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-692357177',id=4,image_ref='67d3cd1b-dcdc-4323-9b14-42851ba967c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiGnL1DwEH0XOO6wP5AWOdeonAHQyPqZ/53Pb9j1U2Bw+Cd9oenz6v6RCdhe8cMGrrgvZXT4FQjn7zeCu0yx7IAOpfNRMx35sUub7peU+4eoYF8WVv7p1o0PiLu3uNFeg==',key_name='tempest-keypair-1798601504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d468f624a3d4526ab4422c7a1bea2f0',ramdisk_id='',reservation_id='r-o17c1xvh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67d3cd1b-dcdc-4323-9b14-42851ba967c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1478825930',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1478825930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6851a124ff8e4fe6a08810a8b257eff7',uuid=2629c515-bd23-4df8-bdfc-4e84c0c06e5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Converting VIF {"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c9:12,bridge_name='br-int',has_traffic_filtering=True,id=620ab99e-0aa9-4b39-9963-dc38976df1f4,network=Network(18880a12-34d7-461a-b276-40f81a2d5769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620ab99e-0a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.objects.instance [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lazy-loading 'pci_devices' on Instance uuid 2629c515-bd23-4df8-bdfc-4e84c0c06e5a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:08:01 user nova-compute[76815]: INFO oslo.privsep.daemon [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Spawned new privsep daemon via rootwrap
Nov 14 22:08:01 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 22:08:01 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 22:08:01 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 22:08:01 user nova-compute[76815]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86648
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:08:01 user nova-compute[76815]:   <uuid>2629c515-bd23-4df8-bdfc-4e84c0c06e5a</uuid>
Nov 14 22:08:01 user nova-compute[76815]:   <name>instance-00000004</name>
Nov 14 22:08:01 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:08:01 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:08:01 user nova-compute[76815]:   <metadata>
Nov 14 22:08:01 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:08:01 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:08:01 user nova-compute[76815]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-692357177</nova:name>
Nov 14 22:08:01 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:08:01</nova:creationTime>
Nov 14 22:08:01 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:08:01 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:08:01 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:08:01 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:08:01 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:08:01 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:08:01 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:08:01 user nova-compute[76815]:       <nova:owner>
Nov 14 22:08:01 user nova-compute[76815]:         <nova:user uuid="6851a124ff8e4fe6a08810a8b257eff7">tempest-AttachSCSIVolumeTestJSON-1478825930-project-member</nova:user>
Nov 14 22:08:01 user nova-compute[76815]:         <nova:project uuid="7d468f624a3d4526ab4422c7a1bea2f0">tempest-AttachSCSIVolumeTestJSON-1478825930</nova:project>
Nov 14 22:08:01 user nova-compute[76815]:       </nova:owner>
Nov 14 22:08:01 user nova-compute[76815]:       <nova:root type="image" uuid="67d3cd1b-dcdc-4323-9b14-42851ba967c5"/>
Nov 14 22:08:01 user nova-compute[76815]:       <nova:ports>
Nov 14 22:08:01 user nova-compute[76815]:         <nova:port uuid="620ab99e-0aa9-4b39-9963-dc38976df1f4">
Nov 14 22:08:01 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 22:08:01 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:01 user nova-compute[76815]:       </nova:ports>
Nov 14 22:08:01 user nova-compute[76815]:     </nova:instance>
Nov 14 22:08:01 user nova-compute[76815]:   </metadata>
Nov 14 22:08:01 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:08:01 user nova-compute[76815]:     <system>
Nov 14 22:08:01 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:08:01 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:08:01 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:08:01 user nova-compute[76815]:       <entry name="serial">2629c515-bd23-4df8-bdfc-4e84c0c06e5a</entry>
Nov 14 22:08:01 user nova-compute[76815]:       <entry name="uuid">2629c515-bd23-4df8-bdfc-4e84c0c06e5a</entry>
Nov 14 22:08:01 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:08:01 user nova-compute[76815]:     </system>
Nov 14 22:08:01 user nova-compute[76815]:   </sysinfo>
Nov 14 22:08:01 user nova-compute[76815]:   <os>
Nov 14 22:08:01 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:08:01 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:08:01 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:08:01 user nova-compute[76815]:   </os>
Nov 14 22:08:01 user nova-compute[76815]:   <features>
Nov 14 22:08:01 user nova-compute[76815]:     <acpi/>
Nov 14 22:08:01 user nova-compute[76815]:     <apic/>
Nov 14 22:08:01 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:08:01 user nova-compute[76815]:   </features>
Nov 14 22:08:01 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:08:01 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:08:01 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:08:01 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:08:01 user nova-compute[76815]:   </clock>
Nov 14 22:08:01 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:08:01 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:08:01 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:08:01 user nova-compute[76815]:   </cpu>
Nov 14 22:08:01 user nova-compute[76815]:   <devices>
Nov 14 22:08:01 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:08:01 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:08:01 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk"/>
Nov 14 22:08:01 user nova-compute[76815]:       <target dev="sda" bus="scsi"/>
Nov 14 22:08:01 user nova-compute[76815]:       <address type="drive" controller="0" unit="0"/>
Nov 14 22:08:01 user nova-compute[76815]:     </disk>
Nov 14 22:08:01 user nova-compute[76815]:     <disk type="file" device="cdrom">
Nov 14 22:08:01 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 22:08:01 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk.config"/>
Nov 14 22:08:01 user nova-compute[76815]:       <target dev="sdb" bus="scsi"/>
Nov 14 22:08:01 user nova-compute[76815]:       <address type="drive" controller="0" unit="1"/>
Nov 14 22:08:01 user nova-compute[76815]:     </disk>
Nov 14 22:08:01 user nova-compute[76815]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 22:08:01 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:01 user nova-compute[76815]:       <mac address="fa:16:3e:c4:c9:12"/>
Nov 14 22:08:01 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:01 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:01 user nova-compute[76815]:       <target dev="tap620ab99e-0a"/>
Nov 14 22:08:01 user nova-compute[76815]:     </interface>
Nov 14 22:08:01 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:08:01 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/console.log" append="off"/>
Nov 14 22:08:01 user nova-compute[76815]:     </serial>
Nov 14 22:08:01 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:08:01 user nova-compute[76815]:     <video>
Nov 14 22:08:01 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:01 user nova-compute[76815]:     </video>
Nov 14 22:08:01 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:08:01 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:08:01 user nova-compute[76815]:     </rng>
Nov 14 22:08:01 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:08:01 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:08:01 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:08:01 user nova-compute[76815]:     </memballoon>
Nov 14 22:08:01 user nova-compute[76815]:   </devices>
Nov 14 22:08:01 user nova-compute[76815]: </domain>
Nov 14 22:08:01 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-692357177',display_name='tempest-AttachSCSIVolumeTestJSON-server-692357177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-692357177',id=4,image_ref='67d3cd1b-dcdc-4323-9b14-42851ba967c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiGnL1DwEH0XOO6wP5AWOdeonAHQyPqZ/53Pb9j1U2Bw+Cd9oenz6v6RCdhe8cMGrrgvZXT4FQjn7zeCu0yx7IAOpfNRMx35sUub7peU+4eoYF8WVv7p1o0PiLu3uNFeg==',key_name='tempest-keypair-1798601504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d468f624a3d4526ab4422c7a1bea2f0',ramdisk_id='',reservation_id='r-o17c1xvh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67d3cd1b-dcdc-4323-9b14-42851ba967c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1478825930',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1478825930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6851a124ff8e4fe6a08810a8b257eff7',uuid=2629c515-bd23-4df8-bdfc-4e84c0c06e5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Converting VIF {"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c9:12,bridge_name='br-int',has_traffic_filtering=True,id=620ab99e-0aa9-4b39-9963-dc38976df1f4,network=Network(18880a12-34d7-461a-b276-40f81a2d5769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620ab99e-0a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG os_vif [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c9:12,bridge_name='br-int',has_traffic_filtering=True,id=620ab99e-0aa9-4b39-9963-dc38976df1f4,network=Network(18880a12-34d7-461a-b276-40f81a2d5769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620ab99e-0a') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9e48f0a-5fa8-5250-b974-f482a377035c', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap620ab99e-0a, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap620ab99e-0a, col_values=(('qos', UUID('be45b487-9c22-4a59-a9bb-a9e6cdca4133')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap620ab99e-0a, col_values=(('external_ids', {'iface-id': '620ab99e-0aa9-4b39-9963-dc38976df1f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:c9:12', 'vm-uuid': '2629c515-bd23-4df8-bdfc-4e84c0c06e5a'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0ee221-156f-4797-abdd-d3cf7e15cdf2]: (2,) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:01 user nova-compute[76815]: INFO os_vif [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:c9:12,bridge_name='br-int',has_traffic_filtering=True,id=620ab99e-0aa9-4b39-9963-dc38976df1f4,network=Network(18880a12-34d7-461a-b276-40f81a2d5769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620ab99e-0a')
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.305s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] No BDM found with device name sda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] No VIF found with MAC fa:16:3e:c4:c9:12, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:08:01 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Using config drive
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad7d347-7709-495a-a880-b7af66462174]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:01 user nova-compute[76815]: WARNING os_brick.initiator.connectors.nvmeof [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eea7087-7ea6-460f-a329-6eedda0d4004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.220s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.038s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adabb4c-7127-471b-88c5-6deb365066d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8996fcc-33e4-4109-8a75-c4749d911495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk 1073741824" returned: 0 in 0.112s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:01 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[970dd2b9-87c9-4553-ba43-4eb010f4772f]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG os_brick.utils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] <== get_connector_properties: return (2785ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updating existing volume attachment record: 007aaf1e-d651-44b0-aa2d-f130198cccf8 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.234s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:08:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-71333155-ec06-419b-bfcb-41f327ccf074 req-10a029dc-d574-400b-88df-40bc6520b743 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received event network-vif-plugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-71333155-ec06-419b-bfcb-41f327ccf074 req-10a029dc-d574-400b-88df-40bc6520b743 service nova] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-71333155-ec06-419b-bfcb-41f327ccf074 req-10a029dc-d574-400b-88df-40bc6520b743 service nova] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-71333155-ec06-419b-bfcb-41f327ccf074 req-10a029dc-d574-400b-88df-40bc6520b743 service nova] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-71333155-ec06-419b-bfcb-41f327ccf074 req-10a029dc-d574-400b-88df-40bc6520b743 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] No waiting events found dispatching network-vif-plugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:02 user nova-compute[76815]: WARNING nova.compute.manager [req-71333155-ec06-419b-bfcb-41f327ccf074 req-10a029dc-d574-400b-88df-40bc6520b743 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received unexpected event network-vif-plugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 for instance with vm_state building and task_state spawning.
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:02 user nova-compute[76815]: WARNING nova.compute.manager [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state active and task_state None.
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:02 user nova-compute[76815]: WARNING nova.compute.manager [req-eda7ddc3-941c-42bd-a31c-341f2bf9d168 req-2628f181-b75e-4130-9486-7fc68c0dee0c service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state active and task_state None.
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json" returned: 0 in 0.365s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Cannot resize image /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Ensure instance console log exists: /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.network.neutron [req-3039bbb8-1876-4f1c-8850-5410ad367083 req-a0b8481b-3993-4966-9f00-b5ae612a27c1 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Updated VIF entry in instance network info cache for port 620ab99e-0aa9-4b39-9963-dc38976df1f4. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.network.neutron [req-3039bbb8-1876-4f1c-8850-5410ad367083 req-a0b8481b-3993-4966-9f00-b5ae612a27c1 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Updating instance_info_cache with network_info: [{"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:02 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Instance spawned successfully.
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Successfully created port: 5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3039bbb8-1876-4f1c-8850-5410ad367083 req-a0b8481b-3993-4966-9f00-b5ae612a27c1 service nova] Releasing lock "refresh_cache-2629c515-bd23-4df8-bdfc-4e84c0c06e5a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:02 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Creating config drive at /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk.config
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxvpd3z3u {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxvpd3z3u" returned: 0 in 0.095s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:02 user nova-compute[76815]: INFO nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Took 9.32 seconds to spawn the instance on the hypervisor.
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:02 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:08:02 user nova-compute[76815]: INFO nova.compute.claims [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Claim successful on node user
Nov 14 22:08:02 user nova-compute[76815]: INFO nova.compute.manager [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Took 10.26 seconds to build instance.
Nov 14 22:08:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fdf9f1e5-71cb-4b60-b691-cdec7f2e8213 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.417s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:08:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Successfully updated port: 46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquired lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.policy [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac44b3e767af4aafbf494fbe992dd138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999bc848ab4843739549ca07ab50e2f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Successfully updated port: 5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquired lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:08:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Creating image(s)
Nov 14 22:08:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "/opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "/opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-5550a635-869e-4382-98ef-b3cd48cdce1e req-2c19a9d3-59db-4b8f-81c8-8b46e357e56c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-changed-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-5550a635-869e-4382-98ef-b3cd48cdce1e req-2c19a9d3-59db-4b8f-81c8-8b46e357e56c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Refreshing instance network info cache due to event network-changed-46306924-6ee9-480c-87a9-6a4a86acaa7e. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5550a635-869e-4382-98ef-b3cd48cdce1e req-2c19a9d3-59db-4b8f-81c8-8b46e357e56c service nova] Acquiring lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.198s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.016s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-8f76b446-88ca-4dda-8173-93399eecbab2 req-60e37303-63d4-4807-8ecc-7b85fe35cfe0 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-changed-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-8f76b446-88ca-4dda-8173-93399eecbab2 req-60e37303-63d4-4807-8ecc-7b85fe35cfe0 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Refreshing instance network info cache due to event network-changed-5688ed4c-da6e-445f-9839-2d49c9724bc8. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8f76b446-88ca-4dda-8173-93399eecbab2 req-60e37303-63d4-4807-8ecc-7b85fe35cfe0 service nova] Acquiring lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updating instance_info_cache with network_info: [{"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.283s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Releasing lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Instance network_info: |[{"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8f76b446-88ca-4dda-8173-93399eecbab2 req-60e37303-63d4-4807-8ecc-7b85fe35cfe0 service nova] Acquired lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-8f76b446-88ca-4dda-8173-93399eecbab2 req-60e37303-63d4-4807-8ecc-7b85fe35cfe0 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Refreshing network info cache for port 5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Start _get_guest_xml network_info=[{"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk 1073741824" returned: 0 in 0.111s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.399s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:04 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:04 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239797802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239797802',id=6,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp1I2ExuD5M3u6m5DSKi2h8Sbi9eJkAW82TUikZkZ6/CmyHFgzEt+tH3XphSvsi+i6IpnxEg23xGXTPTV8VZcAvDG1z9g4zldZJtkz5P+3Huuf8Uxsjfoa/XNo/Ex9vg==',key_name='tempest-keypair-1648996082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f304c47366c4cd1af23a1f0d43d8825',ramdisk_id='',reservation_id='r-m3vhi65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1610929038',owner_user_name='tempest-TaggedAttachmentsTest-1610929038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3356e497cd5243beb1e6d5aa0b24a177',uuid=91830a3a-8395-4f82-81c3-6aec79a46c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converting VIF {"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=5688ed4c-da6e-445f-9839-2d49c9724bc8,network=Network(38dbc616-1fd6-4fe5-8ad0-00f3bf562906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5688ed4c-da') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.objects.instance [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lazy-loading 'pci_devices' on Instance uuid 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updating instance_info_cache with network_info: [{"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:08:04 user nova-compute[76815]:   <uuid>91830a3a-8395-4f82-81c3-6aec79a46c33</uuid>
Nov 14 22:08:04 user nova-compute[76815]:   <name>instance-00000006</name>
Nov 14 22:08:04 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:08:04 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:08:04 user nova-compute[76815]:   <metadata>
Nov 14 22:08:04 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:08:04 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:08:04 user nova-compute[76815]:       <nova:name>tempest-device-tagging-server-239797802</nova:name>
Nov 14 22:08:04 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:08:04</nova:creationTime>
Nov 14 22:08:04 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:08:04 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:08:04 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:08:04 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:08:04 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:08:04 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:08:04 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:08:04 user nova-compute[76815]:       <nova:owner>
Nov 14 22:08:04 user nova-compute[76815]:         <nova:user uuid="3356e497cd5243beb1e6d5aa0b24a177">tempest-TaggedAttachmentsTest-1610929038-project-member</nova:user>
Nov 14 22:08:04 user nova-compute[76815]:         <nova:project uuid="3f304c47366c4cd1af23a1f0d43d8825">tempest-TaggedAttachmentsTest-1610929038</nova:project>
Nov 14 22:08:04 user nova-compute[76815]:       </nova:owner>
Nov 14 22:08:04 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:08:04 user nova-compute[76815]:       <nova:ports>
Nov 14 22:08:04 user nova-compute[76815]:         <nova:port uuid="5688ed4c-da6e-445f-9839-2d49c9724bc8">
Nov 14 22:08:04 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:08:04 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:04 user nova-compute[76815]:       </nova:ports>
Nov 14 22:08:04 user nova-compute[76815]:     </nova:instance>
Nov 14 22:08:04 user nova-compute[76815]:   </metadata>
Nov 14 22:08:04 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:08:04 user nova-compute[76815]:     <system>
Nov 14 22:08:04 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:08:04 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:08:04 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:08:04 user nova-compute[76815]:       <entry name="serial">91830a3a-8395-4f82-81c3-6aec79a46c33</entry>
Nov 14 22:08:04 user nova-compute[76815]:       <entry name="uuid">91830a3a-8395-4f82-81c3-6aec79a46c33</entry>
Nov 14 22:08:04 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:08:04 user nova-compute[76815]:     </system>
Nov 14 22:08:04 user nova-compute[76815]:   </sysinfo>
Nov 14 22:08:04 user nova-compute[76815]:   <os>
Nov 14 22:08:04 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:08:04 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:08:04 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:08:04 user nova-compute[76815]:   </os>
Nov 14 22:08:04 user nova-compute[76815]:   <features>
Nov 14 22:08:04 user nova-compute[76815]:     <acpi/>
Nov 14 22:08:04 user nova-compute[76815]:     <apic/>
Nov 14 22:08:04 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:08:04 user nova-compute[76815]:   </features>
Nov 14 22:08:04 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:08:04 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:08:04 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:08:04 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:08:04 user nova-compute[76815]:   </clock>
Nov 14 22:08:04 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:08:04 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:08:04 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:08:04 user nova-compute[76815]:   </cpu>
Nov 14 22:08:04 user nova-compute[76815]:   <devices>
Nov 14 22:08:04 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:08:04 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:08:04 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk"/>
Nov 14 22:08:04 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:08:04 user nova-compute[76815]:     </disk>
Nov 14 22:08:04 user nova-compute[76815]:     <disk type="file" device="cdrom">
Nov 14 22:08:04 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 22:08:04 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk.config"/>
Nov 14 22:08:04 user nova-compute[76815]:       <target dev="hda" bus="ide"/>
Nov 14 22:08:04 user nova-compute[76815]:     </disk>
Nov 14 22:08:04 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:04 user nova-compute[76815]:       <mac address="fa:16:3e:21:d0:50"/>
Nov 14 22:08:04 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:04 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:04 user nova-compute[76815]:       <target dev="tap5688ed4c-da"/>
Nov 14 22:08:04 user nova-compute[76815]:     </interface>
Nov 14 22:08:04 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:08:04 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/console.log" append="off"/>
Nov 14 22:08:04 user nova-compute[76815]:     </serial>
Nov 14 22:08:04 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:08:04 user nova-compute[76815]:     <video>
Nov 14 22:08:04 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:04 user nova-compute[76815]:     </video>
Nov 14 22:08:04 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:08:04 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:08:04 user nova-compute[76815]:     </rng>
Nov 14 22:08:04 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:08:04 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:08:04 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:08:04 user nova-compute[76815]:     </memballoon>
Nov 14 22:08:04 user nova-compute[76815]:   </devices>
Nov 14 22:08:04 user nova-compute[76815]: </domain>
Nov 14 22:08:04 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239797802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239797802',id=6,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp1I2ExuD5M3u6m5DSKi2h8Sbi9eJkAW82TUikZkZ6/CmyHFgzEt+tH3XphSvsi+i6IpnxEg23xGXTPTV8VZcAvDG1z9g4zldZJtkz5P+3Huuf8Uxsjfoa/XNo/Ex9vg==',key_name='tempest-keypair-1648996082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f304c47366c4cd1af23a1f0d43d8825',ramdisk_id='',reservation_id='r-m3vhi65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1610929038',owner_user_name='tempest-TaggedAttachmentsTest-1610929038-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3356e497cd5243beb1e6d5aa0b24a177',uuid=91830a3a-8395-4f82-81c3-6aec79a46c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converting VIF {"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=5688ed4c-da6e-445f-9839-2d49c9724bc8,network=Network(38dbc616-1fd6-4fe5-8ad0-00f3bf562906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5688ed4c-da') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG os_vif [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=5688ed4c-da6e-445f-9839-2d49c9724bc8,network=Network(38dbc616-1fd6-4fe5-8ad0-00f3bf562906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5688ed4c-da') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d48926d-f783-5d20-8c6b-e549f271cbf0', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Releasing lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance network_info: |[{"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5550a635-869e-4382-98ef-b3cd48cdce1e req-2c19a9d3-59db-4b8f-81c8-8b46e357e56c service nova] Acquired lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-5550a635-869e-4382-98ef-b3cd48cdce1e req-2c19a9d3-59db-4b8f-81c8-8b46e357e56c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Refreshing network info cache for port 46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5688ed4c-da, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5688ed4c-da, col_values=(('qos', UUID('ddad2a43-915b-4c25-a146-783318e69991')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5688ed4c-da, col_values=(('external_ids', {'iface-id': '5688ed4c-da6e-445f-9839-2d49c9724bc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:d0:50', 'vm-uuid': '91830a3a-8395-4f82-81c3-6aec79a46c33'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:04 user nova-compute[76815]: INFO os_vif [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=5688ed4c-da6e-445f-9839-2d49c9724bc8,network=Network(38dbc616-1fd6-4fe5-8ad0-00f3bf562906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5688ed4c-da')
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.268s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:08:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] No BDM found with device name hda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] No VIF found with MAC fa:16:3e:21:d0:50, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:08:05 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Using config drive
Nov 14 22:08:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json" returned: 0 in 0.357s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Cannot resize image /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Ensure instance console log exists: /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:05 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Creating config drive at /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk.config
Nov 14 22:08:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyquzuxuk {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.network.neutron [req-8f76b446-88ca-4dda-8173-93399eecbab2 req-60e37303-63d4-4807-8ecc-7b85fe35cfe0 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updated VIF entry in instance network info cache for port 5688ed4c-da6e-445f-9839-2d49c9724bc8. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.network.neutron [req-8f76b446-88ca-4dda-8173-93399eecbab2 req-60e37303-63d4-4807-8ecc-7b85fe35cfe0 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updating instance_info_cache with network_info: [{"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyquzuxuk" returned: 0 in 0.112s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Successfully created port: f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8f76b446-88ca-4dda-8173-93399eecbab2 req-60e37303-63d4-4807-8ecc-7b85fe35cfe0 service nova] Releasing lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.network.neutron [req-5550a635-869e-4382-98ef-b3cd48cdce1e req-2c19a9d3-59db-4b8f-81c8-8b46e357e56c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updated VIF entry in instance network info cache for port 46306924-6ee9-480c-87a9-6a4a86acaa7e. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG nova.network.neutron [req-5550a635-869e-4382-98ef-b3cd48cdce1e req-2c19a9d3-59db-4b8f-81c8-8b46e357e56c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updating instance_info_cache with network_info: [{"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5550a635-869e-4382-98ef-b3cd48cdce1e req-2c19a9d3-59db-4b8f-81c8-8b46e357e56c service nova] Releasing lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Successfully updated port: f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "refresh_cache-ab3b7495-76be-421d-9843-af965b815413" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquired lock "refresh_cache-ab3b7495-76be-421d-9843-af965b815413" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-1c802a8c-99c3-4fb7-af6e-0a5147fefcae req-227c81dd-3c60-4f2c-ab58-54aedbfc02f3 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received event network-changed-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-1c802a8c-99c3-4fb7-af6e-0a5147fefcae req-227c81dd-3c60-4f2c-ab58-54aedbfc02f3 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Refreshing instance network info cache due to event network-changed-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c802a8c-99c3-4fb7-af6e-0a5147fefcae req-227c81dd-3c60-4f2c-ab58-54aedbfc02f3 service nova] Acquiring lock "refresh_cache-ab3b7495-76be-421d-9843-af965b815413" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:08:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Instance spawned successfully.
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Updating instance_info_cache with network_info: [{"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:07 user nova-compute[76815]: INFO nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Took 10.36 seconds to spawn the instance on the hypervisor.
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Releasing lock "refresh_cache-ab3b7495-76be-421d-9843-af965b815413" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Instance network_info: |[{"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c802a8c-99c3-4fb7-af6e-0a5147fefcae req-227c81dd-3c60-4f2c-ab58-54aedbfc02f3 service nova] Acquired lock "refresh_cache-ab3b7495-76be-421d-9843-af965b815413" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c802a8c-99c3-4fb7-af6e-0a5147fefcae req-227c81dd-3c60-4f2c-ab58-54aedbfc02f3 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Refreshing network info cache for port f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Start _get_guest_xml network_info=[{"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:08:07 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:07 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-a2f25856-d135-4396-98d6-63dc436b3c11 req-efce9734-34d6-4dac-94a9-b0aac247f091 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-plugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a2f25856-d135-4396-98d6-63dc436b3c11 req-efce9734-34d6-4dac-94a9-b0aac247f091 service nova] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a2f25856-d135-4396-98d6-63dc436b3c11 req-efce9734-34d6-4dac-94a9-b0aac247f091 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a2f25856-d135-4396-98d6-63dc436b3c11 req-efce9734-34d6-4dac-94a9-b0aac247f091 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-a2f25856-d135-4396-98d6-63dc436b3c11 req-efce9734-34d6-4dac-94a9-b0aac247f091 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] No waiting events found dispatching network-vif-plugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:07 user nova-compute[76815]: WARNING nova.compute.manager [req-a2f25856-d135-4396-98d6-63dc436b3c11 req-efce9734-34d6-4dac-94a9-b0aac247f091 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received unexpected event network-vif-plugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 for instance with vm_state building and task_state spawning.
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1798569789',display_name='tempest-TestVolumeSwap-server-1798569789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1798569789',id=7,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxEXuy2KN9PYIaEVKPEZBzlkx9bY5ojOv43XV8JKQqwKOKCoqP8czbRKZeplBPuNCxUqgqQOc8AZZeTQiqwRLSsk4qUTxur0pqzLAooMbpOj9M8Og4dMdnF2V6mnEb2gA==',key_name='tempest-keypair-137952451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='999bc848ab4843739549ca07ab50e2f2',ramdisk_id='',reservation_id='r-4puo170d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-654708364',owner_user_name='tempest-TestVolumeSwap-654708364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac44b3e767af4aafbf494fbe992dd138',uuid=ab3b7495-76be-421d-9843-af965b815413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Converting VIF {"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:90:44,bridge_name='br-int',has_traffic_filtering=True,id=f1a1d68c-a423-4b04-a0ac-b9b345bb91c0,network=Network(2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a1d68c-a4') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.objects.instance [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lazy-loading 'pci_devices' on Instance uuid ab3b7495-76be-421d-9843-af965b815413 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:08:07 user nova-compute[76815]:   <uuid>ab3b7495-76be-421d-9843-af965b815413</uuid>
Nov 14 22:08:07 user nova-compute[76815]:   <name>instance-00000007</name>
Nov 14 22:08:07 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:08:07 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:08:07 user nova-compute[76815]:   <metadata>
Nov 14 22:08:07 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:08:07 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:08:07 user nova-compute[76815]:       <nova:name>tempest-TestVolumeSwap-server-1798569789</nova:name>
Nov 14 22:08:07 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:08:07</nova:creationTime>
Nov 14 22:08:07 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:08:07 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:08:07 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:08:07 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:08:07 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:08:07 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:08:07 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:08:07 user nova-compute[76815]:       <nova:owner>
Nov 14 22:08:07 user nova-compute[76815]:         <nova:user uuid="ac44b3e767af4aafbf494fbe992dd138">tempest-TestVolumeSwap-654708364-project-member</nova:user>
Nov 14 22:08:07 user nova-compute[76815]:         <nova:project uuid="999bc848ab4843739549ca07ab50e2f2">tempest-TestVolumeSwap-654708364</nova:project>
Nov 14 22:08:07 user nova-compute[76815]:       </nova:owner>
Nov 14 22:08:07 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:08:07 user nova-compute[76815]:       <nova:ports>
Nov 14 22:08:07 user nova-compute[76815]:         <nova:port uuid="f1a1d68c-a423-4b04-a0ac-b9b345bb91c0">
Nov 14 22:08:07 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 22:08:07 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:07 user nova-compute[76815]:       </nova:ports>
Nov 14 22:08:07 user nova-compute[76815]:     </nova:instance>
Nov 14 22:08:07 user nova-compute[76815]:   </metadata>
Nov 14 22:08:07 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:08:07 user nova-compute[76815]:     <system>
Nov 14 22:08:07 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:08:07 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:08:07 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:08:07 user nova-compute[76815]:       <entry name="serial">ab3b7495-76be-421d-9843-af965b815413</entry>
Nov 14 22:08:07 user nova-compute[76815]:       <entry name="uuid">ab3b7495-76be-421d-9843-af965b815413</entry>
Nov 14 22:08:07 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:08:07 user nova-compute[76815]:     </system>
Nov 14 22:08:07 user nova-compute[76815]:   </sysinfo>
Nov 14 22:08:07 user nova-compute[76815]:   <os>
Nov 14 22:08:07 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:08:07 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:08:07 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:08:07 user nova-compute[76815]:   </os>
Nov 14 22:08:07 user nova-compute[76815]:   <features>
Nov 14 22:08:07 user nova-compute[76815]:     <acpi/>
Nov 14 22:08:07 user nova-compute[76815]:     <apic/>
Nov 14 22:08:07 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:08:07 user nova-compute[76815]:   </features>
Nov 14 22:08:07 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:08:07 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:08:07 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:08:07 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:08:07 user nova-compute[76815]:   </clock>
Nov 14 22:08:07 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:08:07 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:08:07 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:08:07 user nova-compute[76815]:   </cpu>
Nov 14 22:08:07 user nova-compute[76815]:   <devices>
Nov 14 22:08:07 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:08:07 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:08:07 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk"/>
Nov 14 22:08:07 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:08:07 user nova-compute[76815]:     </disk>
Nov 14 22:08:07 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:07 user nova-compute[76815]:       <mac address="fa:16:3e:ee:90:44"/>
Nov 14 22:08:07 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:07 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:07 user nova-compute[76815]:       <target dev="tapf1a1d68c-a4"/>
Nov 14 22:08:07 user nova-compute[76815]:     </interface>
Nov 14 22:08:07 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:08:07 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/console.log" append="off"/>
Nov 14 22:08:07 user nova-compute[76815]:     </serial>
Nov 14 22:08:07 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:08:07 user nova-compute[76815]:     <video>
Nov 14 22:08:07 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:07 user nova-compute[76815]:     </video>
Nov 14 22:08:07 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:08:07 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:08:07 user nova-compute[76815]:     </rng>
Nov 14 22:08:07 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:08:07 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:08:07 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:08:07 user nova-compute[76815]:     </memballoon>
Nov 14 22:08:07 user nova-compute[76815]:   </devices>
Nov 14 22:08:07 user nova-compute[76815]: </domain>
Nov 14 22:08:07 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1798569789',display_name='tempest-TestVolumeSwap-server-1798569789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1798569789',id=7,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxEXuy2KN9PYIaEVKPEZBzlkx9bY5ojOv43XV8JKQqwKOKCoqP8czbRKZeplBPuNCxUqgqQOc8AZZeTQiqwRLSsk4qUTxur0pqzLAooMbpOj9M8Og4dMdnF2V6mnEb2gA==',key_name='tempest-keypair-137952451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='999bc848ab4843739549ca07ab50e2f2',ramdisk_id='',reservation_id='r-4puo170d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-654708364',owner_user_name='tempest-TestVolumeSwap-654708364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac44b3e767af4aafbf494fbe992dd138',uuid=ab3b7495-76be-421d-9843-af965b815413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Converting VIF {"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:90:44,bridge_name='br-int',has_traffic_filtering=True,id=f1a1d68c-a423-4b04-a0ac-b9b345bb91c0,network=Network(2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a1d68c-a4') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG os_vif [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:90:44,bridge_name='br-int',has_traffic_filtering=True,id=f1a1d68c-a423-4b04-a0ac-b9b345bb91c0,network=Network(2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a1d68c-a4') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de16521f-b650-50bf-9181-60f7a46b0501', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1a1d68c-a4, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1a1d68c-a4, col_values=(('qos', UUID('dc234e9e-1273-4e97-ac75-69ee5b6516ca')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1a1d68c-a4, col_values=(('external_ids', {'iface-id': 'f1a1d68c-a423-4b04-a0ac-b9b345bb91c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:90:44', 'vm-uuid': 'ab3b7495-76be-421d-9843-af965b815413'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:07 user nova-compute[76815]: INFO os_vif [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:90:44,bridge_name='br-int',has_traffic_filtering=True,id=f1a1d68c-a423-4b04-a0ac-b9b345bb91c0,network=Network(2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a1d68c-a4')
Nov 14 22:08:08 user nova-compute[76815]: INFO nova.compute.manager [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Took 11.77 seconds to build instance.
Nov 14 22:08:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7db3c1ec-5b0c-4525-9f29-957b75a6b3e4 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.050s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] No VIF found with MAC fa:16:3e:ee:90:44, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:08:08 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Creating image(s)
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Ensure instance console log exists: /opt/stack/data/nova/instances/16c58923-c97e-4148-af31-9609b9af5d80/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Start _get_guest_xml network_info=[{"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNAXDfGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16c58923-c97e-4148-af31-9609b9af5d80', 'attached_at': '', 'detached_at': '', 'volume_id': '0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'serial': '0ddc9d17-eda6-4c6d-96e2-2179bc7fd343'}, 'attachment_id': '007aaf1e-d651-44b0-aa2d-f130198cccf8', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:08:08 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:08 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:08:08 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connector [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Factory for ISCSI on None {{(pid=76815) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNAXDfGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:09 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:09 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:09 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cbf92e-c246-4c57-9c68-14ad331ebf4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:08:09 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea187666-a587-4572-a2fe-ecf5805e8976]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343] added
Nov 14 22:08:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cb87d9-389b-4623-9e49-22620f8ad5ca]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab3ccd9-9a2b-439b-9da3-5e3fde539385]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNAXDfGd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNAXDfGd" returned: 0 in 0.071s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6918e709-f015-4761-975d-1d684e577112]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HNAXDfGd'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dcdd45-b5b9-4195-89d1-9d55c8c97503]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fba94e-7713-4ec9-a3e6-093e561069fc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:08:09 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:08:09 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:09 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:08:09 user nova-compute[76815]: 
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c802a8c-99c3-4fb7-af6e-0a5147fefcae req-227c81dd-3c60-4f2c-ab58-54aedbfc02f3 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Updated VIF entry in instance network info cache for port f1a1d68c-a423-4b04-a0ac-b9b345bb91c0. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c802a8c-99c3-4fb7-af6e-0a5147fefcae req-227c81dd-3c60-4f2c-ab58-54aedbfc02f3 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Updating instance_info_cache with network_info: [{"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[08072f76-4b3f-4e08-8e87-80a4665c1d02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260]
Nov 14 22:08:09 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260] successful.
Nov 14 22:08:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c802a8c-99c3-4fb7-af6e-0a5147fefcae req-227c81dd-3c60-4f2c-ab58-54aedbfc02f3 service nova] Releasing lock "refresh_cache-ab3b7495-76be-421d-9843-af965b815413" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:08:09 user nova-compute[76815]: INFO nova.compute.claims [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Claim successful on node user
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[23445e63-babf-4c11-a76b-db97bf6af6ad]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[90abeabd-c249-4860-b946-e41cfc8c3697]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.476s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f3693-0500-497e-9b52-1ce03cfaf061]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNAXDfGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-37efc1b5-765e-407d-9c30-88d815bbdc15 req-aa050efb-067c-4da5-b7f1-fd604d6e0475 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-plugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37efc1b5-765e-407d-9c30-88d815bbdc15 req-aa050efb-067c-4da5-b7f1-fd604d6e0475 service nova] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37efc1b5-765e-407d-9c30-88d815bbdc15 req-aa050efb-067c-4da5-b7f1-fd604d6e0475 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37efc1b5-765e-407d-9c30-88d815bbdc15 req-aa050efb-067c-4da5-b7f1-fd604d6e0475 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-37efc1b5-765e-407d-9c30-88d815bbdc15 req-aa050efb-067c-4da5-b7f1-fd604d6e0475 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] No waiting events found dispatching network-vif-plugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:10 user nova-compute[76815]: WARNING nova.compute.manager [req-37efc1b5-765e-407d-9c30-88d815bbdc15 req-aa050efb-067c-4da5-b7f1-fd604d6e0475 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received unexpected event network-vif-plugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 for instance with vm_state building and task_state spawning.
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] <== connect_volume: return (1545ms) {'type': 'block', 'scsi_wwn': '26237383437613733', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237383437613733', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.183s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-195882950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-195882950',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYdEPXMAY/BvZ90CFnDjbrUDJXhggicS+WTg8lo2jdxV4Oxwqif3KxZzm7Zj/wEOoKk76K9c60Oj4htrIR82n8KAEFJjDSxue+s6ZxqtfvL8qnYb+moLbO3gRh8JV6Bug==',key_name='tempest-keypair-958525764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a73af2afa50e415d85402bbea4bb143a',ramdisk_id='',reservation_id='r-rwperlky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-310072271',owner_user_name='tempest-ServerActionsV293TestJSON-310072271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51594092be7f40638e43426bf32e5290',uuid=16c58923-c97e-4148-af31-9609b9af5d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converting VIF {"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.objects.instance [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lazy-loading 'pci_devices' on Instance uuid 16c58923-c97e-4148-af31-9609b9af5d80 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:08:10 user nova-compute[76815]:   <uuid>16c58923-c97e-4148-af31-9609b9af5d80</uuid>
Nov 14 22:08:10 user nova-compute[76815]:   <name>instance-00000005</name>
Nov 14 22:08:10 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:08:10 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:08:10 user nova-compute[76815]:   <metadata>
Nov 14 22:08:10 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:08:10 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:08:10 user nova-compute[76815]:       <nova:name>tempest-ServerActionsV293TestJSON-server-195882950</nova:name>
Nov 14 22:08:10 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:08:08</nova:creationTime>
Nov 14 22:08:10 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:08:10 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:08:10 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:08:10 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:08:10 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:08:10 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:08:10 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:08:10 user nova-compute[76815]:       <nova:owner>
Nov 14 22:08:10 user nova-compute[76815]:         <nova:user uuid="51594092be7f40638e43426bf32e5290">tempest-ServerActionsV293TestJSON-310072271-project-member</nova:user>
Nov 14 22:08:10 user nova-compute[76815]:         <nova:project uuid="a73af2afa50e415d85402bbea4bb143a">tempest-ServerActionsV293TestJSON-310072271</nova:project>
Nov 14 22:08:10 user nova-compute[76815]:       </nova:owner>
Nov 14 22:08:10 user nova-compute[76815]:       <nova:ports>
Nov 14 22:08:10 user nova-compute[76815]:         <nova:port uuid="46306924-6ee9-480c-87a9-6a4a86acaa7e">
Nov 14 22:08:10 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 22:08:10 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:10 user nova-compute[76815]:       </nova:ports>
Nov 14 22:08:10 user nova-compute[76815]:     </nova:instance>
Nov 14 22:08:10 user nova-compute[76815]:   </metadata>
Nov 14 22:08:10 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:08:10 user nova-compute[76815]:     <system>
Nov 14 22:08:10 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:08:10 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:08:10 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:08:10 user nova-compute[76815]:       <entry name="serial">16c58923-c97e-4148-af31-9609b9af5d80</entry>
Nov 14 22:08:10 user nova-compute[76815]:       <entry name="uuid">16c58923-c97e-4148-af31-9609b9af5d80</entry>
Nov 14 22:08:10 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:08:10 user nova-compute[76815]:     </system>
Nov 14 22:08:10 user nova-compute[76815]:   </sysinfo>
Nov 14 22:08:10 user nova-compute[76815]:   <os>
Nov 14 22:08:10 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:08:10 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:08:10 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:08:10 user nova-compute[76815]:   </os>
Nov 14 22:08:10 user nova-compute[76815]:   <features>
Nov 14 22:08:10 user nova-compute[76815]:     <acpi/>
Nov 14 22:08:10 user nova-compute[76815]:     <apic/>
Nov 14 22:08:10 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:08:10 user nova-compute[76815]:   </features>
Nov 14 22:08:10 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:08:10 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:08:10 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:08:10 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:08:10 user nova-compute[76815]:   </clock>
Nov 14 22:08:10 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:08:10 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:08:10 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:08:10 user nova-compute[76815]:   </cpu>
Nov 14 22:08:10 user nova-compute[76815]:   <devices>
Nov 14 22:08:10 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:08:10 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:08:10 user nova-compute[76815]:       <source dev="/dev/sdb"/>
Nov 14 22:08:10 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:08:10 user nova-compute[76815]:       <serial>0ddc9d17-eda6-4c6d-96e2-2179bc7fd343</serial>
Nov 14 22:08:10 user nova-compute[76815]:     </disk>
Nov 14 22:08:10 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:10 user nova-compute[76815]:       <mac address="fa:16:3e:3f:b3:fb"/>
Nov 14 22:08:10 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:10 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:10 user nova-compute[76815]:       <target dev="tap46306924-6e"/>
Nov 14 22:08:10 user nova-compute[76815]:     </interface>
Nov 14 22:08:10 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:08:10 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/16c58923-c97e-4148-af31-9609b9af5d80/console.log" append="off"/>
Nov 14 22:08:10 user nova-compute[76815]:     </serial>
Nov 14 22:08:10 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:08:10 user nova-compute[76815]:     <video>
Nov 14 22:08:10 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:10 user nova-compute[76815]:     </video>
Nov 14 22:08:10 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:08:10 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:08:10 user nova-compute[76815]:     </rng>
Nov 14 22:08:10 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:08:10 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:08:10 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:08:10 user nova-compute[76815]:     </memballoon>
Nov 14 22:08:10 user nova-compute[76815]:   </devices>
Nov 14 22:08:10 user nova-compute[76815]: </domain>
Nov 14 22:08:10 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-195882950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-195882950',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYdEPXMAY/BvZ90CFnDjbrUDJXhggicS+WTg8lo2jdxV4Oxwqif3KxZzm7Zj/wEOoKk76K9c60Oj4htrIR82n8KAEFJjDSxue+s6ZxqtfvL8qnYb+moLbO3gRh8JV6Bug==',key_name='tempest-keypair-958525764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a73af2afa50e415d85402bbea4bb143a',ramdisk_id='',reservation_id='r-rwperlky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-310072271',owner_user_name='tempest-ServerActionsV293TestJSON-310072271-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51594092be7f40638e43426bf32e5290',uuid=16c58923-c97e-4148-af31-9609b9af5d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converting VIF {"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG os_vif [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d9d0ece-3a7c-579b-b245-b7a36c502733', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46306924-6e, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46306924-6e, col_values=(('qos', UUID('d01936be-e7ef-4e9e-8514-dda17e937c46')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46306924-6e, col_values=(('external_ids', {'iface-id': '46306924-6ee9-480c-87a9-6a4a86acaa7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:b3:fb', 'vm-uuid': '16c58923-c97e-4148-af31-9609b9af5d80'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.network.neutron [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:08:10 user nova-compute[76815]: INFO os_vif [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e')
Nov 14 22:08:10 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.policy [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e4c449a38e544cc994bd98914310b36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1e36264b084350965e57944e11f950', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] No VIF found with MAC fa:16:3e:3f:b3:fb, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:08:10 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Instance spawned successfully.
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:08:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Creating image(s)
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "/opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "/opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:11 user nova-compute[76815]: INFO nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Took 10.12 seconds to spawn the instance on the hypervisor.
Nov 14 22:08:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:11 user nova-compute[76815]: INFO nova.compute.manager [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Took 11.42 seconds to build instance.
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5a750395-ed69-4b3e-925e-32bcbbc585ab tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.773s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.319s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.241s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG nova.network.neutron [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Successfully created port: 2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk 1073741824" returned: 0 in 0.080s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.224s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:08:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Cannot resize image /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Ensure instance console log exists: /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:08:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: ab3b7495-76be-421d-9843-af965b815413] Instance spawned successfully.
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.network.neutron [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Successfully updated port: 2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquiring lock "refresh_cache-fd038c28-ee30-4cbe-a0aa-518396ac9fc7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquired lock "refresh_cache-fd038c28-ee30-4cbe-a0aa-518396ac9fc7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.network.neutron [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:08:12 user nova-compute[76815]: INFO nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Took 8.89 seconds to spawn the instance on the hypervisor.
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-c51185b8-5f75-4e3d-8776-04e439aa8256 req-009775da-4807-4572-9cfd-198131ec2d4c service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received event network-changed-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-c51185b8-5f75-4e3d-8776-04e439aa8256 req-009775da-4807-4572-9cfd-198131ec2d4c service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Refreshing instance network info cache due to event network-changed-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c51185b8-5f75-4e3d-8776-04e439aa8256 req-009775da-4807-4572-9cfd-198131ec2d4c service nova] Acquiring lock "refresh_cache-fd038c28-ee30-4cbe-a0aa-518396ac9fc7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.network.neutron [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:13 user nova-compute[76815]: INFO nova.compute.manager [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Took 10.30 seconds to build instance.
Nov 14 22:08:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6a65ff38-0edd-431e-b96d-e6e4b17c31c0 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.707s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.network.neutron [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Updating instance_info_cache with network_info: [{"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Releasing lock "refresh_cache-fd038c28-ee30-4cbe-a0aa-518396ac9fc7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Instance network_info: |[{"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c51185b8-5f75-4e3d-8776-04e439aa8256 req-009775da-4807-4572-9cfd-198131ec2d4c service nova] Acquired lock "refresh_cache-fd038c28-ee30-4cbe-a0aa-518396ac9fc7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.network.neutron [req-c51185b8-5f75-4e3d-8776-04e439aa8256 req-009775da-4807-4572-9cfd-198131ec2d4c service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Refreshing network info cache for port 2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Start _get_guest_xml network_info=[{"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:08:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1037971562',display_name='tempest-VolumesAssistedSnapshotsTest-server-1037971562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1037971562',id=8,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUO7iX3RDRULy/pFghpVkS2onmYTPk+weXeCOCyAJUtnLUTo5F0kuNkQJpQP3hL/UFam/wbF0kHpP+rLyAy7eg2mARAWCzvG766udico0PjTKJqRlcJMLuCUaPPhEj7Rg==',key_name='tempest-keypair-186302895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a1e36264b084350965e57944e11f950',ramdisk_id='',reservation_id='r-5qtfnn2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-310688643',owner_user_name='tempest-VolumesAssistedSnapshotsTest-310688643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e4c449a38e544cc994bd98914310b36',uuid=fd038c28-ee30-4cbe-a0aa-518396ac9fc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Converting VIF {"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41,network=Network(d3e452a3-6a79-47e4-b9e9-4cecd0cae866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3e12eb-00') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.objects.instance [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lazy-loading 'pci_devices' on Instance uuid fd038c28-ee30-4cbe-a0aa-518396ac9fc7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:08:13 user nova-compute[76815]:   <uuid>fd038c28-ee30-4cbe-a0aa-518396ac9fc7</uuid>
Nov 14 22:08:13 user nova-compute[76815]:   <name>instance-00000008</name>
Nov 14 22:08:13 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:08:13 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:08:13 user nova-compute[76815]:   <metadata>
Nov 14 22:08:13 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:08:13 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:08:13 user nova-compute[76815]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1037971562</nova:name>
Nov 14 22:08:13 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:08:13</nova:creationTime>
Nov 14 22:08:13 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:08:13 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:08:13 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:08:13 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:08:13 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:08:13 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:08:13 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:08:13 user nova-compute[76815]:       <nova:owner>
Nov 14 22:08:13 user nova-compute[76815]:         <nova:user uuid="6e4c449a38e544cc994bd98914310b36">tempest-VolumesAssistedSnapshotsTest-310688643-project-member</nova:user>
Nov 14 22:08:13 user nova-compute[76815]:         <nova:project uuid="8a1e36264b084350965e57944e11f950">tempest-VolumesAssistedSnapshotsTest-310688643</nova:project>
Nov 14 22:08:13 user nova-compute[76815]:       </nova:owner>
Nov 14 22:08:13 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:08:13 user nova-compute[76815]:       <nova:ports>
Nov 14 22:08:13 user nova-compute[76815]:         <nova:port uuid="2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41">
Nov 14 22:08:13 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:08:13 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:13 user nova-compute[76815]:       </nova:ports>
Nov 14 22:08:13 user nova-compute[76815]:     </nova:instance>
Nov 14 22:08:13 user nova-compute[76815]:   </metadata>
Nov 14 22:08:13 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:08:13 user nova-compute[76815]:     <system>
Nov 14 22:08:13 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:08:13 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:08:13 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:08:13 user nova-compute[76815]:       <entry name="serial">fd038c28-ee30-4cbe-a0aa-518396ac9fc7</entry>
Nov 14 22:08:13 user nova-compute[76815]:       <entry name="uuid">fd038c28-ee30-4cbe-a0aa-518396ac9fc7</entry>
Nov 14 22:08:13 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:08:13 user nova-compute[76815]:     </system>
Nov 14 22:08:13 user nova-compute[76815]:   </sysinfo>
Nov 14 22:08:13 user nova-compute[76815]:   <os>
Nov 14 22:08:13 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:08:13 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:08:13 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:08:13 user nova-compute[76815]:   </os>
Nov 14 22:08:13 user nova-compute[76815]:   <features>
Nov 14 22:08:13 user nova-compute[76815]:     <acpi/>
Nov 14 22:08:13 user nova-compute[76815]:     <apic/>
Nov 14 22:08:13 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:08:13 user nova-compute[76815]:   </features>
Nov 14 22:08:13 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:08:13 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:08:13 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:08:13 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:08:13 user nova-compute[76815]:   </clock>
Nov 14 22:08:13 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:08:13 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:08:13 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:08:13 user nova-compute[76815]:   </cpu>
Nov 14 22:08:13 user nova-compute[76815]:   <devices>
Nov 14 22:08:13 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:08:13 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:08:13 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk"/>
Nov 14 22:08:13 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:08:13 user nova-compute[76815]:     </disk>
Nov 14 22:08:13 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:13 user nova-compute[76815]:       <mac address="fa:16:3e:fb:2d:b5"/>
Nov 14 22:08:13 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:13 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:13 user nova-compute[76815]:       <target dev="tap2b3e12eb-00"/>
Nov 14 22:08:13 user nova-compute[76815]:     </interface>
Nov 14 22:08:13 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:08:13 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/console.log" append="off"/>
Nov 14 22:08:13 user nova-compute[76815]:     </serial>
Nov 14 22:08:13 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:08:13 user nova-compute[76815]:     <video>
Nov 14 22:08:13 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:13 user nova-compute[76815]:     </video>
Nov 14 22:08:13 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:08:13 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:08:13 user nova-compute[76815]:     </rng>
Nov 14 22:08:13 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:08:13 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:08:13 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:08:13 user nova-compute[76815]:     </memballoon>
Nov 14 22:08:13 user nova-compute[76815]:   </devices>
Nov 14 22:08:13 user nova-compute[76815]: </domain>
Nov 14 22:08:13 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1037971562',display_name='tempest-VolumesAssistedSnapshotsTest-server-1037971562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1037971562',id=8,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUO7iX3RDRULy/pFghpVkS2onmYTPk+weXeCOCyAJUtnLUTo5F0kuNkQJpQP3hL/UFam/wbF0kHpP+rLyAy7eg2mARAWCzvG766udico0PjTKJqRlcJMLuCUaPPhEj7Rg==',key_name='tempest-keypair-186302895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a1e36264b084350965e57944e11f950',ramdisk_id='',reservation_id='r-5qtfnn2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-310688643',owner_user_name='tempest-VolumesAssistedSnapshotsTest-310688643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e4c449a38e544cc994bd98914310b36',uuid=fd038c28-ee30-4cbe-a0aa-518396ac9fc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Converting VIF {"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41,network=Network(d3e452a3-6a79-47e4-b9e9-4cecd0cae866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3e12eb-00') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG os_vif [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41,network=Network(d3e452a3-6a79-47e4-b9e9-4cecd0cae866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3e12eb-00') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '203c6ba8-4ebc-5d53-a51b-f6147aae7720', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b3e12eb-00, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b3e12eb-00, col_values=(('qos', UUID('8c7da674-134a-4415-9a73-85f59fba7894')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b3e12eb-00, col_values=(('external_ids', {'iface-id': '2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:2d:b5', 'vm-uuid': 'fd038c28-ee30-4cbe-a0aa-518396ac9fc7'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:13 user nova-compute[76815]: INFO os_vif [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41,network=Network(d3e452a3-6a79-47e4-b9e9-4cecd0cae866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3e12eb-00')
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] No VIF found with MAC fa:16:3e:fb:2d:b5, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:08:14 user nova-compute[76815]: DEBUG nova.network.neutron [req-c51185b8-5f75-4e3d-8776-04e439aa8256 req-009775da-4807-4572-9cfd-198131ec2d4c service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Updated VIF entry in instance network info cache for port 2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:08:14 user nova-compute[76815]: DEBUG nova.network.neutron [req-c51185b8-5f75-4e3d-8776-04e439aa8256 req-009775da-4807-4572-9cfd-198131ec2d4c service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Updating instance_info_cache with network_info: [{"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c51185b8-5f75-4e3d-8776-04e439aa8256 req-009775da-4807-4572-9cfd-198131ec2d4c service nova] Releasing lock "refresh_cache-fd038c28-ee30-4cbe-a0aa-518396ac9fc7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-33701476-b1ae-429f-8df3-f600a5d21da4 req-05fbd2c6-fcfe-4b82-95ec-c176f6ff74ac service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received event network-vif-plugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-33701476-b1ae-429f-8df3-f600a5d21da4 req-05fbd2c6-fcfe-4b82-95ec-c176f6ff74ac service nova] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-33701476-b1ae-429f-8df3-f600a5d21da4 req-05fbd2c6-fcfe-4b82-95ec-c176f6ff74ac service nova] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-33701476-b1ae-429f-8df3-f600a5d21da4 req-05fbd2c6-fcfe-4b82-95ec-c176f6ff74ac service nova] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-33701476-b1ae-429f-8df3-f600a5d21da4 req-05fbd2c6-fcfe-4b82-95ec-c176f6ff74ac service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] No waiting events found dispatching network-vif-plugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:15 user nova-compute[76815]: WARNING nova.compute.manager [req-33701476-b1ae-429f-8df3-f600a5d21da4 req-05fbd2c6-fcfe-4b82-95ec-c176f6ff74ac service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received unexpected event network-vif-plugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 for instance with vm_state active and task_state None.
Nov 14 22:08:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance spawned successfully.
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:15 user nova-compute[76815]: INFO nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Took 7.06 seconds to spawn the instance on the hypervisor.
Nov 14 22:08:15 user nova-compute[76815]: DEBUG nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:08:16 user nova-compute[76815]: INFO nova.compute.manager [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Took 19.14 seconds to build instance.
Nov 14 22:08:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-93f13c5c-3f8c-4df2-a1be-99bd13a559bc tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "16c58923-c97e-4148-af31-9609b9af5d80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.364s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received event network-vif-plugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] No waiting events found dispatching network-vif-plugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:17 user nova-compute[76815]: WARNING nova.compute.manager [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received unexpected event network-vif-plugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 for instance with vm_state active and task_state None.
Nov 14 22:08:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received event network-vif-plugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] No waiting events found dispatching network-vif-plugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:17 user nova-compute[76815]: WARNING nova.compute.manager [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received unexpected event network-vif-plugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 for instance with vm_state building and task_state spawning.
Nov 14 22:08:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received event network-vif-plugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] No waiting events found dispatching network-vif-plugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:17 user nova-compute[76815]: WARNING nova.compute.manager [req-43928a55-30ee-41a3-9858-e652d02ec79e req-55e77fef-62c2-490e-8deb-d8850bd32267 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received unexpected event network-vif-plugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 for instance with vm_state building and task_state spawning.
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:08:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Instance spawned successfully.
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:08:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:18 user nova-compute[76815]: INFO nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Took 7.74 seconds to spawn the instance on the hypervisor.
Nov 14 22:08:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:08:19 user nova-compute[76815]: INFO nova.compute.manager [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Took 9.75 seconds to build instance.
Nov 14 22:08:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-242ec234-a90d-4a16-9c92-67828fb13e93 tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.970s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "38304882-101f-43c4-8c18-028c609924d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:08:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:08:19 user nova-compute[76815]: INFO nova.compute.claims [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Claim successful on node user
Nov 14 22:08:20 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.004s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:08:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:08:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:08:20 user nova-compute[76815]: INFO nova.compute.claims [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Claim successful on node user
Nov 14 22:08:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:08:21 user nova-compute[76815]: INFO nova.virt.block_device [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Booting with volume 238dec76-05fe-46ce-98de-e10e9d11e989 at /dev/vda
Nov 14 22:08:21 user nova-compute[76815]: DEBUG nova.policy [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5dd134d793c843deaa9fe6928f9df4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a68a14955fe4688a7e303058c8fba5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG os_brick.utils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f59c1c-e7a3-49df-b3f3-066d950428a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8882bb46-eb02-4031-b385-a9926eb54ec9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75a77d1-ecc9-40c8-8f71-17a56a8af859]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a4e8bd-5436-41b5-b253-7b857f75f7ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:21 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[98135301-ebc6-4826-a8bc-731a4d1451d7]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG os_brick.utils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating existing volume attachment record: e0fff9b7-6d74-4006-8242-99dcc4195946 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.894s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:08:21 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:08:21 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:08:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:08:22 user nova-compute[76815]: INFO nova.virt.block_device [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Booting with volume 246fd01d-c901-4337-b731-c811598fa1e6 at /dev/vda
Nov 14 22:08:22 user nova-compute[76815]: DEBUG nova.policy [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2ad62182181480ca51d6c5f570f2da9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28dbae2c095c49008bb5c596305055ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG os_brick.utils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0404c2c-82e2-44b2-b5d5-b03c8bd4b511]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c303b3-3eac-417f-9d27-e82d160b67a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e562b99-37d7-4496-98a3-af137845e5f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e05701-3d7c-4c84-a9e3-83241fe8677e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:22 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:08:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae16e79-7a11-45fd-ad0f-ba3509735178]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG os_brick.utils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating existing volume attachment record: 57aeb600-d2b4-4722-afac-47cf18525561 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:08:22 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully created port: 181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:23 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully created port: 8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:23 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully created port: 891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:08:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:08:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:08:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:24 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully created port: a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:24 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully created port: 6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:25 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully created port: 6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:26 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully created port: 2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:26 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully created port: d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully created port: 9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully updated port: 181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-cf4adf33-9c6a-4f36-a87a-de6dad221603 req-51b49c2b-e923-4d52-bf25-be195f06f9f8 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-changed-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-cf4adf33-9c6a-4f36-a87a-de6dad221603 req-51b49c2b-e923-4d52-bf25-be195f06f9f8 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing instance network info cache due to event network-changed-181fec50-aed8-46cf-8926-666ba8b4ccad. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cf4adf33-9c6a-4f36-a87a-de6dad221603 req-51b49c2b-e923-4d52-bf25-be195f06f9f8 service nova] Acquiring lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cf4adf33-9c6a-4f36-a87a-de6dad221603 req-51b49c2b-e923-4d52-bf25-be195f06f9f8 service nova] Acquired lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-cf4adf33-9c6a-4f36-a87a-de6dad221603 req-51b49c2b-e923-4d52-bf25-be195f06f9f8 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing network info cache for port 181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-cf4adf33-9c6a-4f36-a87a-de6dad221603 req-51b49c2b-e923-4d52-bf25-be195f06f9f8 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully created port: f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:28 user nova-compute[76815]: INFO nova.virt.block_device [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Booting with volume 8a59b07f-36d8-46f0-8d7a-268d0e381b41 at /dev/vdb
Nov 14 22:08:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-cf4adf33-9c6a-4f36-a87a-de6dad221603 req-51b49c2b-e923-4d52-bf25-be195f06f9f8 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cf4adf33-9c6a-4f36-a87a-de6dad221603 req-51b49c2b-e923-4d52-bf25-be195f06f9f8 service nova] Releasing lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG os_brick.utils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e3a28e-323a-490a-bad9-046eb1331056]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94600014-be08-439e-826c-2e980a6a5321]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55a7136-bf6c-4f29-99c6-1ec30a538ff7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4de6e7-7090-4484-8ffd-39257c7536a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:28 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:08:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69970bd-3c08-4e79-896b-e81938ea65ee]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG os_brick.utils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:28 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating existing volume attachment record: 0710268f-8e2b-48df-bc15-ac3e9038c231 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully updated port: 00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:29 user nova-compute[76815]: INFO nova.virt.block_device [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Booting with volume 9dcbc826-b341-4c2e-bfef-1b8d906dbe5b at /dev/vdb
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG os_brick.utils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caf5ec0-c546-40fa-8cb7-831bc5792d74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0b7c7d-e8c6-4ac2-999c-37aa57c457cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb4a7b-b8fd-4e25-a6a0-8b3cd0618c49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[539fdb0c-5bdd-47c8-9ab2-947b0b6c386b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully updated port: 891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:29 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8266b6e1-b03f-43e5-bb6b-f71460a39125]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG os_brick.utils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] <== get_connector_properties: return (326ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating existing volume attachment record: 933c44b6-4697-4d88-9976-7bb7bdcce9d1 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-f1b7b295-dbe5-4324-a55e-4fa47691ef6d req-a8ea90fa-500a-4966-859b-b6ea282519f7 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-changed-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-f1b7b295-dbe5-4324-a55e-4fa47691ef6d req-a8ea90fa-500a-4966-859b-b6ea282519f7 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing instance network info cache due to event network-changed-891499b5-a743-47f5-be77-20fd703dba98. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f1b7b295-dbe5-4324-a55e-4fa47691ef6d req-a8ea90fa-500a-4966-859b-b6ea282519f7 service nova] Acquiring lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f1b7b295-dbe5-4324-a55e-4fa47691ef6d req-a8ea90fa-500a-4966-859b-b6ea282519f7 service nova] Acquired lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-f1b7b295-dbe5-4324-a55e-4fa47691ef6d req-a8ea90fa-500a-4966-859b-b6ea282519f7 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing network info cache for port 891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json" returned: 0 in 0.348s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-9a0e0833-b514-492f-ac58-515c7217a686 req-af832f85-44bd-4881-955a-bd788e08799a service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-changed-00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-9a0e0833-b514-492f-ac58-515c7217a686 req-af832f85-44bd-4881-955a-bd788e08799a service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing instance network info cache due to event network-changed-00031166-05b9-413e-814b-3d9ca500dce6. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9a0e0833-b514-492f-ac58-515c7217a686 req-af832f85-44bd-4881-955a-bd788e08799a service nova] Acquiring lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9a0e0833-b514-492f-ac58-515c7217a686 req-af832f85-44bd-4881-955a-bd788e08799a service nova] Acquired lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-9a0e0833-b514-492f-ac58-515c7217a686 req-af832f85-44bd-4881-955a-bd788e08799a service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing network info cache for port 00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully updated port: 41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-f1b7b295-dbe5-4324-a55e-4fa47691ef6d req-a8ea90fa-500a-4966-859b-b6ea282519f7 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-9a0e0833-b514-492f-ac58-515c7217a686 req-af832f85-44bd-4881-955a-bd788e08799a service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-f1b7b295-dbe5-4324-a55e-4fa47691ef6d req-a8ea90fa-500a-4966-859b-b6ea282519f7 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f1b7b295-dbe5-4324-a55e-4fa47691ef6d req-a8ea90fa-500a-4966-859b-b6ea282519f7 service nova] Releasing lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-9a0e0833-b514-492f-ac58-515c7217a686 req-af832f85-44bd-4881-955a-bd788e08799a service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9a0e0833-b514-492f-ac58-515c7217a686 req-af832f85-44bd-4881-955a-bd788e08799a service nova] Releasing lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:31 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully updated port: faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:31 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully updated port: 8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-d00b5be2-1924-494a-b288-667847ff34a5 req-cb2e1f3e-6fec-4737-9a58-657e0b6f7dce service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-changed-faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-d00b5be2-1924-494a-b288-667847ff34a5 req-cb2e1f3e-6fec-4737-9a58-657e0b6f7dce service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing instance network info cache due to event network-changed-faee4c11-33ce-44e5-a8a6-761459aed964. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d00b5be2-1924-494a-b288-667847ff34a5 req-cb2e1f3e-6fec-4737-9a58-657e0b6f7dce service nova] Acquiring lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d00b5be2-1924-494a-b288-667847ff34a5 req-cb2e1f3e-6fec-4737-9a58-657e0b6f7dce service nova] Acquired lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.network.neutron [req-d00b5be2-1924-494a-b288-667847ff34a5 req-cb2e1f3e-6fec-4737-9a58-657e0b6f7dce service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing network info cache for port faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-changed-41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing instance network info cache due to event network-changed-41236478-3f4b-4e2e-ae9e-6f0052bfd272. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] Acquiring lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] Acquired lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing network info cache for port 41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:32 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:32 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7597MB free_disk=25.578876495361328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.network.neutron [req-d00b5be2-1924-494a-b288-667847ff34a5 req-cb2e1f3e-6fec-4737-9a58-657e0b6f7dce service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bb235db0-61d3-4e29-9794-b7c181f074d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2629c515-bd23-4df8-bdfc-4e84c0c06e5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 16c58923-c97e-4148-af31-9609b9af5d80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 91830a3a-8395-4f82-81c3-6aec79a46c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ab3b7495-76be-421d-9843-af965b815413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 38304882-101f-43c4-8c18-028c609924d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully updated port: a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.network.neutron [req-d00b5be2-1924-494a-b288-667847ff34a5 req-cb2e1f3e-6fec-4737-9a58-657e0b6f7dce service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d00b5be2-1924-494a-b288-667847ff34a5 req-cb2e1f3e-6fec-4737-9a58-657e0b6f7dce service nova] Releasing lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:32 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully updated port: f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] Releasing lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-changed-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing instance network info cache due to event network-changed-8ef50e3e-aebc-4586-8e02-95e24035c65a. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] Acquiring lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] Acquired lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing network info cache for port 8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.046s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7d9b8a66-0b68-4a8b-86e4-4860070f33ad req-4761fb75-52ec-4522-bbd0-9a80a67c409f service nova] Releasing lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully updated port: 6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:33 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully updated port: 6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-changed-f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing instance network info cache due to event network-changed-f81937c3-cffb-4cb0-8b83-590ed631118f. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] Acquiring lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] Acquired lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing network info cache for port f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-changed-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing instance network info cache due to event network-changed-a2da1829-8bd3-4b37-85b1-2df590321e79. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] Acquiring lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] Acquired lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing network info cache for port a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully updated port: 2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Successfully updated port: d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] Releasing lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-changed-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing instance network info cache due to event network-changed-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] Acquiring lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] Acquired lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing network info cache for port 6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 38304882-101f-43c4-8c18-028c609924d3] Skipping network cache update for instance because it is Building. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Skipping network cache update for instance because it is Building. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid bb235db0-61d3-4e29-9794-b7c181f074d2 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] Releasing lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-changed-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing instance network info cache due to event network-changed-6619c73b-6c5f-4c4a-b53a-99b80bfb6154. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] Acquiring lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] Acquired lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing network info cache for port 6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully updated port: 9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c62290e3-a625-4a86-aac0-db194c8fdbdb req-01910e3b-0fd9-4ec0-a7e3-1687050521c0 service nova] Releasing lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-95981c2e-2626-4a32-a494-d2c3e5838ea7 req-88aaace6-7a8b-4941-a7f6-37df41da9596 service nova] Releasing lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquired lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:35 user nova-compute[76815]: INFO nova.virt.block_device [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Booting with volume a1200f02-ea6b-4100-8310-32379061188b at /dev/vdc
Nov 14 22:08:35 user nova-compute[76815]: DEBUG os_brick.utils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Updating instance_info_cache with network_info: [{"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c2557f-da57-4e0e-a7ec-b452c506228f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dc196d-d79a-4d4f-8051-77c8ada6626d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[010bb6ad-a522-46f7-bac8-acf54ff9ae71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[baec6d3c-33dd-413b-a968-1a39f178fb7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:35 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:08:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db70d36-24fe-4291-ad14-98a3e1aef8cb]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG os_brick.utils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating existing volume attachment record: 3d80300d-7982-4203-b42d-f0ea7b928f37 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:08:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:36 user nova-compute[76815]: INFO nova.virt.block_device [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Booting with volume a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 at /dev/vdc
Nov 14 22:08:36 user nova-compute[76815]: DEBUG os_brick.utils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ffe6cc-644b-4a0c-807d-1a69d0cb8741]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b09c5b-98fd-4b05-a020-b5671f6ab10e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1769aa4-840b-49e5-9977-1bd860ebf9fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e5071-c1b8-4348-8953-4e90e93288ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Successfully updated port: f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-changed-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing instance network info cache due to event network-changed-2918fcad-5d37-4682-945e-c5cda02bcced. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Acquiring lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Acquired lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing network info cache for port 2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-83cc37e2-b904-4097-b8b2-ddc9ab623fe4 req-489a079a-fac4-4b3d-bc1c-6d09faabe5e4 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-changed-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-83cc37e2-b904-4097-b8b2-ddc9ab623fe4 req-489a079a-fac4-4b3d-bc1c-6d09faabe5e4 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing instance network info cache due to event network-changed-d0ff3721-6af3-405f-a239-d7fe1cac99ee. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-83cc37e2-b904-4097-b8b2-ddc9ab623fe4 req-489a079a-fac4-4b3d-bc1c-6d09faabe5e4 service nova] Acquiring lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:08:36 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[deda4980-e2c5-4bbb-80de-e563b5f034cd]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG os_brick.utils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating existing volume attachment record: 5a6b26ab-2931-4fa7-b98c-31d8467963b4 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Releasing lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-changed-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing instance network info cache due to event network-changed-9e313244-7f65-4a20-b837-eaa4c9851d0f. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Acquiring lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Acquired lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing network info cache for port 9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Releasing lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received event network-vif-plugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Acquiring lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] No waiting events found dispatching network-vif-plugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:37 user nova-compute[76815]: WARNING nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received unexpected event network-vif-plugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 for instance with vm_state active and task_state None.
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received event network-vif-plugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Acquiring lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] No waiting events found dispatching network-vif-plugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:37 user nova-compute[76815]: WARNING nova.compute.manager [req-9becb3f0-7ee6-49fc-b8db-b3b7484149b4 req-8c923935-d533-49c0-be94-10b3a10c9694 service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received unexpected event network-vif-plugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 for instance with vm_state active and task_state None.
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquired lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [{"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Releasing lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance network_info: |[{"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-83cc37e2-b904-4097-b8b2-ddc9ab623fe4 req-489a079a-fac4-4b3d-bc1c-6d09faabe5e4 service nova] Acquired lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-83cc37e2-b904-4097-b8b2-ddc9ab623fe4 req-489a079a-fac4-4b3d-bc1c-6d09faabe5e4 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing network info cache for port d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:38 user nova-compute[76815]: DEBUG nova.network.neutron [req-83cc37e2-b904-4097-b8b2-ddc9ab623fe4 req-489a079a-fac4-4b3d-bc1c-6d09faabe5e4 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updated VIF entry in instance network info cache for port d0ff3721-6af3-405f-a239-d7fe1cac99ee. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:08:38 user nova-compute[76815]: DEBUG nova.network.neutron [req-83cc37e2-b904-4097-b8b2-ddc9ab623fe4 req-489a079a-fac4-4b3d-bc1c-6d09faabe5e4 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [{"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-changed-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing instance network info cache due to event network-changed-f266fb6d-022e-4ea5-aa6b-9837fe489168. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:08:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Acquiring lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:08:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-83cc37e2-b904-4097-b8b2-ddc9ab623fe4 req-489a079a-fac4-4b3d-bc1c-6d09faabe5e4 service nova] Releasing lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [{"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Releasing lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance network_info: |[{"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Acquired lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing network info cache for port f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updated VIF entry in instance network info cache for port f266fb6d-022e-4ea5-aa6b-9837fe489168. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [{"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Releasing lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received event network-vif-plugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Lock "ab3b7495-76be-421d-9843-af965b815413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Lock "ab3b7495-76be-421d-9843-af965b815413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] No waiting events found dispatching network-vif-plugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:39 user nova-compute[76815]: WARNING nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received unexpected event network-vif-plugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 for instance with vm_state active and task_state None.
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received event network-vif-plugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Lock "ab3b7495-76be-421d-9843-af965b815413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Lock "ab3b7495-76be-421d-9843-af965b815413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] No waiting events found dispatching network-vif-plugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:39 user nova-compute[76815]: WARNING nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received unexpected event network-vif-plugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 for instance with vm_state active and task_state None.
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] No waiting events found dispatching network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:39 user nova-compute[76815]: WARNING nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received unexpected event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e for instance with vm_state active and task_state None.
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] No waiting events found dispatching network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:39 user nova-compute[76815]: WARNING nova.compute.manager [req-ad440617-e91f-4eb8-9c57-d1833f0b7c1b req-b6d0a6ac-6e25-4ebb-8efa-e563b7ad0053 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received unexpected event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e for instance with vm_state active and task_state None.
Nov 14 22:08:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:08:40 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Creating image(s)
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Ensure instance console log exists: /opt/stack/data/nova/instances/38304882-101f-43c4-8c18-028c609924d3/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Start _get_guest_xml network_info=[{"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXQbsFTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38304882-101f-43c4-8c18-028c609924d3', 'attached_at': '', 'detached_at': '', 'volume_id': '238dec76-05fe-46ce-98de-e10e9d11e989', 'serial': '238dec76-05fe-46ce-98de-e10e9d11e989'}, 'attachment_id': 'e0fff9b7-6d74-4006-8242-99dcc4195946', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnHYpKGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38304882-101f-43c4-8c18-028c609924d3', 'attached_at': '', 'detached_at': '', 'volume_id': '8a59b07f-36d8-46f0-8d7a-268d0e381b41', 'serial': '8a59b07f-36d8-46f0-8d7a-268d0e381b41'}, 'attachment_id': '0710268f-8e2b-48df-bc15-ac3e9038c231', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvjeWpUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38304882-101f-43c4-8c18-028c609924d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1200f02-ea6b-4100-8310-32379061188b', 'serial': 'a1200f02-ea6b-4100-8310-32379061188b'}, 'attachment_id': '3d80300d-7982-4203-b42d-f0ea7b928f37', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:08:40 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:40 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXQbsFTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:40 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:40 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:40 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff66928-9440-4579-a480-e8b044315764]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:08:40 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[830f5f48-8c20-469b-b29e-53f285e6d852]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989] added
Nov 14 22:08:40 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c654316a-5b6b-42d9-bceb-b576fcc1afc2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8283a9b-2f59-4cb4-b975-0adafa337a47]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXQbsFTV {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXQbsFTV" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f7430b-a9de-4216-be02-81dc97cce18b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SXQbsFTV'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[387e1273-cadb-4ee2-86b0-5e723a3242fe]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[699c9ef5-ec2b-4e4c-a5f1-daa25b7f626a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:40 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:40 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf73dfe-6f1d-4985-94ba-de5b88da1058]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989, portal: 172.16.0.220,3260]
Nov 14 22:08:41 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989, portal: 172.16.0.220,3260] successful.
Nov 14 22:08:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d2c291-399b-4ff1-ae9d-e2678e4749a9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e644b4-38f4-4adb-8ab7-721f42460a13]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:41 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:41 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2d3faa-e7a4-4b23-af7d-4b137232f08b]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:08:41 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Creating image(s)
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Ensure instance console log exists: /opt/stack/data/nova/instances/13d9a6bb-bfe4-46b2-977b-4f38b746bbfa/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Start _get_guest_xml network_info=[{"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTYyPBfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa', 'attached_at': '', 'detached_at': '', 'volume_id': '246fd01d-c901-4337-b731-c811598fa1e6', 'serial': '246fd01d-c901-4337-b731-c811598fa1e6'}, 'attachment_id': '57aeb600-d2b4-4722-afac-47cf18525561', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypPhfWud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa', 'attached_at': '', 'detached_at': '', 'volume_id': '9dcbc826-b341-4c2e-bfef-1b8d906dbe5b', 'serial': '9dcbc826-b341-4c2e-bfef-1b8d906dbe5b'}, 'attachment_id': '933c44b6-4697-4d88-9976-7bb7bdcce9d1', 'guest_format': None, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfkBAmCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8', 'serial': 'a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8'}, 'attachment_id': '5a6b26ab-2931-4fa7-b98c-31d8467963b4', 'guest_format': None, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:08:41 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:41 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTYyPBfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:41 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXQbsFTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26530363834663732', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530363834663732', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.570s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:42 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:42 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc71f5fe-c15a-4b04-9772-10e066a1080e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:08:42 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnHYpKGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:42 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cdaec0-2b0e-43ae-9e8b-a886d31c106d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6] added
Nov 14 22:08:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a88dda-e8cd-4d66-9004-32c9f3fd71a4]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[96521560-d546-4c8a-b33f-32a49d1f4eef]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTYyPBfA {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZTYyPBfA" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c269ca-c54d-4c11-92cb-fcda08626531]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZTYyPBfA'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[963d14d0-dbed-4809-9199-bb372c60c152]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[798e4081-c7e1-4b4a-bcf3-ca7f587e2f7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f802ffcf-1bcc-420e-8cd1-86f5e766817d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6, portal: 172.16.0.220,3260]
Nov 14 22:08:42 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6, portal: 172.16.0.220,3260] successful.
Nov 14 22:08:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2d2bb5-1684-4173-b003-aba545332268]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8124fb22-dbf1-43a7-b52b-06caff26b190]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7249dcda-dbf0-4c74-b5d4-48e7cca2b7d1]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:08:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTYyPBfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] <== connect_volume: return (1866ms) {'type': 'block', 'scsi_wwn': '26636636166626331', 'path': '/dev/sdd'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636636166626331', 'path': '/dev/sdd'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.272s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:43 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:43 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5cae78-90da-496b-9eca-5734755a5fe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:08:43 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypPhfWud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:43 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[96af6fe0-9ed6-4097-bf48-d016bdede785]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41] added
Nov 14 22:08:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcdf902-873e-41dc-8348-2a9166cdb05a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e5be2-feac-4a21-a230-dbe19ca111ca]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fnHYpKGx {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fnHYpKGx" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61ed0a0-7fe7-4e63-8270-ebb1982ca6df]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fnHYpKGx'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65e1dc5-f006-4c77-b85d-a8a6b43710da]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ffbdf0-3a54-40b2-935e-8e239008a584]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5f2f4f-a86d-4f65-abbc-8786369b9409]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41, portal: 172.16.0.220,3260]
Nov 14 22:08:43 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41, portal: 172.16.0.220,3260] successful.
Nov 14 22:08:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aaa014-c341-49d7-bf21-7e9a57ed55ce]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2c4bb6-415d-42bc-8038-9cccc92c7fb0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1efe7b1-c359-47b9-a954-139a2c8d58bc]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:08:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnHYpKGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] <== connect_volume: return (2603ms) {'type': 'block', 'scsi_wwn': '23436346231313537', 'path': '/dev/sde'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436346231313537', 'path': '/dev/sde'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.305s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:44 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:44 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvjeWpUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:44 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8026b3-da7b-4aa2-b9c2-f3443a5cc228]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:08:44 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3055b200-d941-470f-992d-8e387cfb929d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b] added
Nov 14 22:08:44 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8702e657-d52e-4725-9439-b579f8ddd8c8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[03808bd5-f18e-400a-a647-5b0a28948a06]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypPhfWud {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ypPhfWud" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fea8cf-9c3a-4020-b0f2-256a137f6847]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ypPhfWud'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcda390-eb03-4b36-81f7-672c94dce675]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdd10a3-e6c5-4cde-a102-4462e31078cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:44 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:44 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:44 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:44 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:44 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:44 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:44 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:44 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[945d48d1-3978-4b12-8fae-db6638197eb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b, portal: 172.16.0.220,3260]
Nov 14 22:08:45 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b, portal: 172.16.0.220,3260] successful.
Nov 14 22:08:45 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cc518f-8593-4a96-a3a1-42f6aebd6bfd]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[32420f67-0b52-4b20-bc9c-e1c4a4799178]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:45 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:45 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:45 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:45 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:45 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:45 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:45 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:45 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:45 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:45 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7795fd45-2c7c-491e-b4e6-2dfcf2eb3015]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:08:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypPhfWud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] <== connect_volume: return (2632ms) {'type': 'block', 'scsi_wwn': '23739643264633334', 'path': '/dev/sdf'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739643264633334', 'path': '/dev/sdf'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.300s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:46 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:46 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a318dc35-bdf7-4c6a-b380-a58b818a55da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:08:46 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfkBAmCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:08:46 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b417f02-3683-497a-a0ee-0a29a660598d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b] added
Nov 14 22:08:46 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ebb76d-4020-4bf1-bd67-06349eb036cc]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6a3a6e-1264-4fc9-a001-a59eb11f0e47]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvjeWpUi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvjeWpUi" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c23c0b-9cc0-49af-8fd8-8300459a688b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvjeWpUi'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[144a5291-1829-4024-aa12-b5382496da3e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd47ad48-1690-4e2c-b69d-6c4a44f50243]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:46 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:46 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[790f05b1-92e2-47d4-b5fe-7d5c0ddc8c5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b, portal: 172.16.0.220,3260]
Nov 14 22:08:46 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b, portal: 172.16.0.220,3260] successful.
Nov 14 22:08:46 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00c4749-3ecb-4516-8cca-2cc750701ef7]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9a6583-8e79-48b5-91c6-f1b1ab7c2fae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:08:46 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:46 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:08:46 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1987031b-f724-419b-a604-f61b79811d8d]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:08:46 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvjeWpUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] <== connect_volume: return (2630ms) {'type': 'block', 'scsi_wwn': '26335616437646566', 'path': '/dev/sdg'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335616437646566', 'path': '/dev/sdg'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.305s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:08:47 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:58:86,bridge_name='br-int',has_traffic_filtering=True,id=181fec50-aed8-46cf-8926-666ba8b4ccad,network=Network(4564429a-fbb9-49ed-a69f-4bb06e543c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181fec50-ae') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:d0,bridge_name='br-int',has_traffic_filtering=True,id=00031166-05b9-413e-814b-3d9ca500dce6,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00031166-05') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ff:88,bridge_name='br-int',has_traffic_filtering=True,id=41236478-3f4b-4e2e-ae9e-6f0052bfd272,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41236478-3f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:cd:42,bridge_name='br-int',has_traffic_filtering=True,id=8ef50e3e-aebc-4586-8e02-95e24035c65a,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef50e3e-ae') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:8f:d3,bridge_name='br-int',has_traffic_filtering=True,id=a2da1829-8bd3-4b37-85b1-2df590321e79,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2da1829-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:90:a7,bridge_name='br-int',has_traffic_filtering=True,id=6619c73b-6c5f-4c4a-b53a-99b80bfb6154,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619c73b-6c') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=d0ff3721-6af3-405f-a239-d7fe1cac99ee,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ff3721-6a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.objects.instance [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lazy-loading 'pci_devices' on Instance uuid 38304882-101f-43c4-8c18-028c609924d3 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bbc2f8-42d7-4d55-b28e-7b27aff266be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:08:47 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:08:47 user nova-compute[76815]:   <uuid>38304882-101f-43c4-8c18-028c609924d3</uuid>
Nov 14 22:08:47 user nova-compute[76815]:   <name>instance-00000009</name>
Nov 14 22:08:47 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:08:47 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:08:47 user nova-compute[76815]:   <metadata>
Nov 14 22:08:47 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:08:47 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:08:47 user nova-compute[76815]:       <nova:name>tempest-device-tagging-server-2019218395</nova:name>
Nov 14 22:08:47 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:08:40</nova:creationTime>
Nov 14 22:08:47 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:08:47 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:08:47 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:08:47 user nova-compute[76815]:       <nova:owner>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:user uuid="5dd134d793c843deaa9fe6928f9df4e5">tempest-TaggedBootDevicesTest_v242-762042002-project-member</nova:user>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:project uuid="9a68a14955fe4688a7e303058c8fba5d">tempest-TaggedBootDevicesTest_v242-762042002</nova:project>
Nov 14 22:08:47 user nova-compute[76815]:       </nova:owner>
Nov 14 22:08:47 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:08:47 user nova-compute[76815]:       <nova:ports>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:port uuid="181fec50-aed8-46cf-8926-666ba8b4ccad">
Nov 14 22:08:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 22:08:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:port uuid="00031166-05b9-413e-814b-3d9ca500dce6">
Nov 14 22:08:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Nov 14 22:08:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:port uuid="41236478-3f4b-4e2e-ae9e-6f0052bfd272">
Nov 14 22:08:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Nov 14 22:08:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:port uuid="8ef50e3e-aebc-4586-8e02-95e24035c65a">
Nov 14 22:08:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Nov 14 22:08:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:port uuid="a2da1829-8bd3-4b37-85b1-2df590321e79">
Nov 14 22:08:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.1.1.245" ipVersion="4"/>
Nov 14 22:08:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:port uuid="6619c73b-6c5f-4c4a-b53a-99b80bfb6154">
Nov 14 22:08:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 22:08:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:47 user nova-compute[76815]:         <nova:port uuid="d0ff3721-6af3-405f-a239-d7fe1cac99ee">
Nov 14 22:08:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 22:08:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:47 user nova-compute[76815]:       </nova:ports>
Nov 14 22:08:47 user nova-compute[76815]:     </nova:instance>
Nov 14 22:08:47 user nova-compute[76815]:   </metadata>
Nov 14 22:08:47 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:08:47 user nova-compute[76815]:     <system>
Nov 14 22:08:47 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:08:47 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:08:47 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:08:47 user nova-compute[76815]:       <entry name="serial">38304882-101f-43c4-8c18-028c609924d3</entry>
Nov 14 22:08:47 user nova-compute[76815]:       <entry name="uuid">38304882-101f-43c4-8c18-028c609924d3</entry>
Nov 14 22:08:47 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:08:47 user nova-compute[76815]:     </system>
Nov 14 22:08:47 user nova-compute[76815]:   </sysinfo>
Nov 14 22:08:47 user nova-compute[76815]:   <os>
Nov 14 22:08:47 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:08:47 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:08:47 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:08:47 user nova-compute[76815]:   </os>
Nov 14 22:08:47 user nova-compute[76815]:   <features>
Nov 14 22:08:47 user nova-compute[76815]:     <acpi/>
Nov 14 22:08:47 user nova-compute[76815]:     <apic/>
Nov 14 22:08:47 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:08:47 user nova-compute[76815]:   </features>
Nov 14 22:08:47 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:08:47 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:08:47 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:08:47 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:08:47 user nova-compute[76815]:   </clock>
Nov 14 22:08:47 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:08:47 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:08:47 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:08:47 user nova-compute[76815]:   </cpu>
Nov 14 22:08:47 user nova-compute[76815]:   <devices>
Nov 14 22:08:47 user nova-compute[76815]:     <disk type="file" device="cdrom">
Nov 14 22:08:47 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 22:08:47 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/38304882-101f-43c4-8c18-028c609924d3/disk.config"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="hda" bus="ide"/>
Nov 14 22:08:47 user nova-compute[76815]:     </disk>
Nov 14 22:08:47 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:08:47 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:08:47 user nova-compute[76815]:       <source dev="/dev/sdc"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <serial>238dec76-05fe-46ce-98de-e10e9d11e989</serial>
Nov 14 22:08:47 user nova-compute[76815]:     </disk>
Nov 14 22:08:47 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:08:47 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:08:47 user nova-compute[76815]:       <source dev="/dev/sde"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <serial>8a59b07f-36d8-46f0-8d7a-268d0e381b41</serial>
Nov 14 22:08:47 user nova-compute[76815]:     </disk>
Nov 14 22:08:47 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:08:47 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:08:47 user nova-compute[76815]:       <source dev="/dev/sdg"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="vdc" bus="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <serial>a1200f02-ea6b-4100-8310-32379061188b</serial>
Nov 14 22:08:47 user nova-compute[76815]:     </disk>
Nov 14 22:08:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:47 user nova-compute[76815]:       <mac address="fa:16:3e:53:58:86"/>
Nov 14 22:08:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="tap181fec50-ae"/>
Nov 14 22:08:47 user nova-compute[76815]:     </interface>
Nov 14 22:08:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:47 user nova-compute[76815]:       <mac address="fa:16:3e:c2:e4:d0"/>
Nov 14 22:08:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="tap00031166-05"/>
Nov 14 22:08:47 user nova-compute[76815]:     </interface>
Nov 14 22:08:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:47 user nova-compute[76815]:       <mac address="fa:16:3e:28:ff:88"/>
Nov 14 22:08:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="tap41236478-3f"/>
Nov 14 22:08:47 user nova-compute[76815]:     </interface>
Nov 14 22:08:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:47 user nova-compute[76815]:       <mac address="fa:16:3e:2a:cd:42"/>
Nov 14 22:08:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="tap8ef50e3e-ae"/>
Nov 14 22:08:47 user nova-compute[76815]:     </interface>
Nov 14 22:08:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:47 user nova-compute[76815]:       <mac address="fa:16:3e:86:8f:d3"/>
Nov 14 22:08:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="tapa2da1829-8b"/>
Nov 14 22:08:47 user nova-compute[76815]:     </interface>
Nov 14 22:08:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:47 user nova-compute[76815]:       <mac address="fa:16:3e:a7:90:a7"/>
Nov 14 22:08:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="tap6619c73b-6c"/>
Nov 14 22:08:47 user nova-compute[76815]:     </interface>
Nov 14 22:08:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:47 user nova-compute[76815]:       <mac address="fa:16:3e:fc:6c:ea"/>
Nov 14 22:08:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:47 user nova-compute[76815]:       <target dev="tapd0ff3721-6a"/>
Nov 14 22:08:47 user nova-compute[76815]:     </interface>
Nov 14 22:08:47 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:08:47 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/38304882-101f-43c4-8c18-028c609924d3/console.log" append="off"/>
Nov 14 22:08:47 user nova-compute[76815]:     </serial>
Nov 14 22:08:47 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:08:47 user nova-compute[76815]:     <video>
Nov 14 22:08:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:47 user nova-compute[76815]:     </video>
Nov 14 22:08:47 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:08:47 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:08:47 user nova-compute[76815]:     </rng>
Nov 14 22:08:47 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:08:47 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:08:47 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:08:47 user nova-compute[76815]:     </memballoon>
Nov 14 22:08:47 user nova-compute[76815]:   </devices>
Nov 14 22:08:47 user nova-compute[76815]: </domain>
Nov 14 22:08:47 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:58:86,bridge_name='br-int',has_traffic_filtering=True,id=181fec50-aed8-46cf-8926-666ba8b4ccad,network=Network(4564429a-fbb9-49ed-a69f-4bb06e543c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181fec50-ae') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:58:86,bridge_name='br-int',has_traffic_filtering=True,id=181fec50-aed8-46cf-8926-666ba8b4ccad,network=Network(4564429a-fbb9-49ed-a69f-4bb06e543c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181fec50-ae') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0616c6b2-8d78-5d03-8d1b-42b3408f258d', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap181fec50-ae, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap181fec50-ae, col_values=(('qos', UUID('8364586d-2870-4102-a91b-11f6a10a3be0')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap181fec50-ae, col_values=(('external_ids', {'iface-id': '181fec50-aed8-46cf-8926-666ba8b4ccad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:58:86', 'vm-uuid': '38304882-101f-43c4-8c18-028c609924d3'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7206737-c68e-4879-bdaf-b7fc4983d438]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8] added
Nov 14 22:08:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: INFO os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:58:86,bridge_name='br-int',has_traffic_filtering=True,id=181fec50-aed8-46cf-8926-666ba8b4ccad,network=Network(4564429a-fbb9-49ed-a69f-4bb06e543c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181fec50-ae')
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:d0,bridge_name='br-int',has_traffic_filtering=True,id=00031166-05b9-413e-814b-3d9ca500dce6,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00031166-05') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:d0,bridge_name='br-int',has_traffic_filtering=True,id=00031166-05b9-413e-814b-3d9ca500dce6,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00031166-05') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11962bde-cede-51e2-ad8c-959418f7d6f1', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f11c6fe-66bd-4f2f-b1c3-2bcc05029fce]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00031166-05, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00031166-05, col_values=(('qos', UUID('81b9eee0-053a-4ae9-9f67-88094059a614')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00031166-05, col_values=(('external_ids', {'iface-id': '00031166-05b9-413e-814b-3d9ca500dce6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:e4:d0', 'vm-uuid': '38304882-101f-43c4-8c18-028c609924d3'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f28f0-c966-48e4-b42e-53f8f4f0543e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PfkBAmCI {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: INFO os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:d0,bridge_name='br-int',has_traffic_filtering=True,id=00031166-05b9-413e-814b-3d9ca500dce6,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00031166-05')
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ff:88,bridge_name='br-int',has_traffic_filtering=True,id=41236478-3f4b-4e2e-ae9e-6f0052bfd272,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41236478-3f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ff:88,bridge_name='br-int',has_traffic_filtering=True,id=41236478-3f4b-4e2e-ae9e-6f0052bfd272,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41236478-3f') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5982fdd9-db70-59e7-996d-7e506b9c1d51', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PfkBAmCI" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52aa33b-c9d2-4a72-b244-f44bf0326101]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PfkBAmCI'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41236478-3f, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41236478-3f, col_values=(('qos', UUID('0234f29b-cd73-484d-896a-2d234044ebe3')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41236478-3f, col_values=(('external_ids', {'iface-id': '41236478-3f4b-4e2e-ae9e-6f0052bfd272', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:ff:88', 'vm-uuid': '38304882-101f-43c4-8c18-028c609924d3'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b8c614-7111-4103-b74e-e375a93b6301]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: INFO os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ff:88,bridge_name='br-int',has_traffic_filtering=True,id=41236478-3f4b-4e2e-ae9e-6f0052bfd272,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41236478-3f')
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:cd:42,bridge_name='br-int',has_traffic_filtering=True,id=8ef50e3e-aebc-4586-8e02-95e24035c65a,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef50e3e-ae') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:cd:42,bridge_name='br-int',has_traffic_filtering=True,id=8ef50e3e-aebc-4586-8e02-95e24035c65a,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef50e3e-ae') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a71a8a8c-cd9f-581d-a797-2909e27cb16a', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dc43c5-52b0-4a88-9222-219464e17f85]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:08:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:08:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ef50e3e-ae, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ef50e3e-ae, col_values=(('qos', UUID('fc158fc0-6571-4d1d-a69f-a02cfa8d4baf')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ef50e3e-ae, col_values=(('external_ids', {'iface-id': '8ef50e3e-aebc-4586-8e02-95e24035c65a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:cd:42', 'vm-uuid': '38304882-101f-43c4-8c18-028c609924d3'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: INFO os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:cd:42,bridge_name='br-int',has_traffic_filtering=True,id=8ef50e3e-aebc-4586-8e02-95e24035c65a,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef50e3e-ae')
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:8f:d3,bridge_name='br-int',has_traffic_filtering=True,id=a2da1829-8bd3-4b37-85b1-2df590321e79,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2da1829-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8f:d3,bridge_name='br-int',has_traffic_filtering=True,id=a2da1829-8bd3-4b37-85b1-2df590321e79,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2da1829-8b') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7b0088-b24b-4ba1-a5ae-7397848214c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8, portal: 172.16.0.220,3260]
Nov 14 22:08:47 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8, portal: 172.16.0.220,3260] successful.
Nov 14 22:08:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3472b017-70bb-5ca3-bf63-b0b53df7558e', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70dec2e-d86f-499a-b59c-3f9540341998]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2da1829-8b, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2da1829-8b, col_values=(('qos', UUID('059142b8-5cfa-4a04-a66e-d3e621befa5a')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2da1829-8b, col_values=(('external_ids', {'iface-id': 'a2da1829-8bd3-4b37-85b1-2df590321e79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:8f:d3', 'vm-uuid': '38304882-101f-43c4-8c18-028c609924d3'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[12671efe-a641-4d24-90e0-d7c25ef891b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:08:47 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:08:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87d821f-c10e-4431-9a4c-90dafe923be6]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfkBAmCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: INFO os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8f:d3,bridge_name='br-int',has_traffic_filtering=True,id=a2da1829-8bd3-4b37-85b1-2df590321e79,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2da1829-8b')
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:90:a7,bridge_name='br-int',has_traffic_filtering=True,id=6619c73b-6c5f-4c4a-b53a-99b80bfb6154,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619c73b-6c') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:90:a7,bridge_name='br-int',has_traffic_filtering=True,id=6619c73b-6c5f-4c4a-b53a-99b80bfb6154,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619c73b-6c') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f0b8ffe-571a-5c14-8ec3-65e8a595c475', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6619c73b-6c, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6619c73b-6c, col_values=(('qos', UUID('68067bfb-73b3-4af4-9cae-e1154f4c50eb')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6619c73b-6c, col_values=(('external_ids', {'iface-id': '6619c73b-6c5f-4c4a-b53a-99b80bfb6154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:90:a7', 'vm-uuid': '38304882-101f-43c4-8c18-028c609924d3'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: INFO os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:90:a7,bridge_name='br-int',has_traffic_filtering=True,id=6619c73b-6c5f-4c4a-b53a-99b80bfb6154,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619c73b-6c')
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=d0ff3721-6af3-405f-a239-d7fe1cac99ee,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ff3721-6a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=d0ff3721-6af3-405f-a239-d7fe1cac99ee,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ff3721-6a') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30471eaf-8ba0-584a-92ce-b69c30d121b4', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ff3721-6a, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ff3721-6a, col_values=(('qos', UUID('ebffae86-74d4-4506-9db5-b09b0ca9ab7d')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ff3721-6a, col_values=(('external_ids', {'iface-id': 'd0ff3721-6af3-405f-a239-d7fe1cac99ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:6c:ea', 'vm-uuid': '38304882-101f-43c4-8c18-028c609924d3'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:48 user nova-compute[76815]: INFO os_vif [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=d0ff3721-6af3-405f-a239-d7fe1cac99ee,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ff3721-6a')
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] No BDM found with device name hda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] No VIF found with MAC fa:16:3e:53:58:86, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] No VIF found with MAC fa:16:3e:86:8f:d3, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:08:48 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Using config drive
Nov 14 22:08:48 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Creating config drive at /opt/stack/data/nova/instances/38304882-101f-43c4-8c18-028c609924d3/disk.config
Nov 14 22:08:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/38304882-101f-43c4-8c18-028c609924d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8l_t0cee {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/38304882-101f-43c4-8c18-028c609924d3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8l_t0cee" returned: 0 in 0.048s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] <== connect_volume: return (2703ms) {'type': 'block', 'scsi_wwn': '23863366532613561', 'path': '/dev/sdh'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863366532613561', 'path': '/dev/sdh'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:cb:e6,bridge_name='br-int',has_traffic_filtering=True,id=891499b5-a743-47f5-be77-20fd703dba98,network=Network(3cfd9c53-400c-4d7e-a306-229b88b184ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891499b5-a7') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:c6,bridge_name='br-int',has_traffic_filtering=True,id=faee4c11-33ce-44e5-a8a6-761459aed964,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfaee4c11-33') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=f81937c3-cffb-4cb0-8b83-590ed631118f,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81937c3-cf') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:45,bridge_name='br-int',has_traffic_filtering=True,id=6b74bfc3-a532-4083-959f-fe3d0ad3ebf5,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74bfc3-a5') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7c:96,bridge_name='br-int',has_traffic_filtering=True,id=2918fcad-5d37-4682-945e-c5cda02bcced,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2918fcad-5d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b4:f4,bridge_name='br-int',has_traffic_filtering=True,id=9e313244-7f65-4a20-b837-eaa4c9851d0f,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e313244-7f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:b8,bridge_name='br-int',has_traffic_filtering=True,id=f266fb6d-022e-4ea5-aa6b-9837fe489168,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf266fb6d-02') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lazy-loading 'pci_devices' on Instance uuid 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:08:48 user nova-compute[76815]:   <uuid>13d9a6bb-bfe4-46b2-977b-4f38b746bbfa</uuid>
Nov 14 22:08:48 user nova-compute[76815]:   <name>instance-0000000a</name>
Nov 14 22:08:48 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:08:48 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:08:48 user nova-compute[76815]:   <metadata>
Nov 14 22:08:48 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:08:48 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:08:48 user nova-compute[76815]:       <nova:name>tempest-device-tagging-server-1233902670</nova:name>
Nov 14 22:08:48 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:08:41</nova:creationTime>
Nov 14 22:08:48 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:08:48 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:08:48 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:08:48 user nova-compute[76815]:       <nova:owner>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:user uuid="a2ad62182181480ca51d6c5f570f2da9">tempest-TaggedBootDevicesTest-71226886-project-member</nova:user>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:project uuid="28dbae2c095c49008bb5c596305055ed">tempest-TaggedBootDevicesTest-71226886</nova:project>
Nov 14 22:08:48 user nova-compute[76815]:       </nova:owner>
Nov 14 22:08:48 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:08:48 user nova-compute[76815]:       <nova:ports>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:port uuid="891499b5-a743-47f5-be77-20fd703dba98">
Nov 14 22:08:48 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 22:08:48 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:port uuid="faee4c11-33ce-44e5-a8a6-761459aed964">
Nov 14 22:08:48 user nova-compute[76815]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
Nov 14 22:08:48 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:port uuid="f81937c3-cffb-4cb0-8b83-590ed631118f">
Nov 14 22:08:48 user nova-compute[76815]:           <nova:ip type="fixed" address="10.1.1.160" ipVersion="4"/>
Nov 14 22:08:48 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:port uuid="6b74bfc3-a532-4083-959f-fe3d0ad3ebf5">
Nov 14 22:08:48 user nova-compute[76815]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Nov 14 22:08:48 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:port uuid="2918fcad-5d37-4682-945e-c5cda02bcced">
Nov 14 22:08:48 user nova-compute[76815]:           <nova:ip type="fixed" address="10.1.1.111" ipVersion="4"/>
Nov 14 22:08:48 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:port uuid="9e313244-7f65-4a20-b837-eaa4c9851d0f">
Nov 14 22:08:48 user nova-compute[76815]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 22:08:48 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:48 user nova-compute[76815]:         <nova:port uuid="f266fb6d-022e-4ea5-aa6b-9837fe489168">
Nov 14 22:08:48 user nova-compute[76815]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 22:08:48 user nova-compute[76815]:         </nova:port>
Nov 14 22:08:48 user nova-compute[76815]:       </nova:ports>
Nov 14 22:08:48 user nova-compute[76815]:     </nova:instance>
Nov 14 22:08:48 user nova-compute[76815]:   </metadata>
Nov 14 22:08:48 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:08:48 user nova-compute[76815]:     <system>
Nov 14 22:08:48 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:08:48 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:08:48 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:08:48 user nova-compute[76815]:       <entry name="serial">13d9a6bb-bfe4-46b2-977b-4f38b746bbfa</entry>
Nov 14 22:08:48 user nova-compute[76815]:       <entry name="uuid">13d9a6bb-bfe4-46b2-977b-4f38b746bbfa</entry>
Nov 14 22:08:48 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:08:48 user nova-compute[76815]:     </system>
Nov 14 22:08:48 user nova-compute[76815]:   </sysinfo>
Nov 14 22:08:48 user nova-compute[76815]:   <os>
Nov 14 22:08:48 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:08:48 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:08:48 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:08:48 user nova-compute[76815]:   </os>
Nov 14 22:08:48 user nova-compute[76815]:   <features>
Nov 14 22:08:48 user nova-compute[76815]:     <acpi/>
Nov 14 22:08:48 user nova-compute[76815]:     <apic/>
Nov 14 22:08:48 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:08:48 user nova-compute[76815]:   </features>
Nov 14 22:08:48 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:08:48 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:08:48 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:08:48 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:08:48 user nova-compute[76815]:   </clock>
Nov 14 22:08:48 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:08:48 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:08:48 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:08:48 user nova-compute[76815]:   </cpu>
Nov 14 22:08:48 user nova-compute[76815]:   <devices>
Nov 14 22:08:48 user nova-compute[76815]:     <disk type="file" device="cdrom">
Nov 14 22:08:48 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 22:08:48 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/13d9a6bb-bfe4-46b2-977b-4f38b746bbfa/disk.config"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="hda" bus="ide"/>
Nov 14 22:08:48 user nova-compute[76815]:     </disk>
Nov 14 22:08:48 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:08:48 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:08:48 user nova-compute[76815]:       <source dev="/dev/sdd"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <serial>246fd01d-c901-4337-b731-c811598fa1e6</serial>
Nov 14 22:08:48 user nova-compute[76815]:     </disk>
Nov 14 22:08:48 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:08:48 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:08:48 user nova-compute[76815]:       <source dev="/dev/sdf"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <serial>9dcbc826-b341-4c2e-bfef-1b8d906dbe5b</serial>
Nov 14 22:08:48 user nova-compute[76815]:     </disk>
Nov 14 22:08:48 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:08:48 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:08:48 user nova-compute[76815]:       <source dev="/dev/sdh"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="vdc" bus="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <serial>a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8</serial>
Nov 14 22:08:48 user nova-compute[76815]:     </disk>
Nov 14 22:08:48 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:48 user nova-compute[76815]:       <mac address="fa:16:3e:b8:cb:e6"/>
Nov 14 22:08:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="tap891499b5-a7"/>
Nov 14 22:08:48 user nova-compute[76815]:     </interface>
Nov 14 22:08:48 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:48 user nova-compute[76815]:       <mac address="fa:16:3e:77:21:c6"/>
Nov 14 22:08:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="tapfaee4c11-33"/>
Nov 14 22:08:48 user nova-compute[76815]:     </interface>
Nov 14 22:08:48 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:48 user nova-compute[76815]:       <mac address="fa:16:3e:73:a2:b5"/>
Nov 14 22:08:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="tapf81937c3-cf"/>
Nov 14 22:08:48 user nova-compute[76815]:     </interface>
Nov 14 22:08:48 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:48 user nova-compute[76815]:       <mac address="fa:16:3e:38:35:45"/>
Nov 14 22:08:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="tap6b74bfc3-a5"/>
Nov 14 22:08:48 user nova-compute[76815]:     </interface>
Nov 14 22:08:48 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:48 user nova-compute[76815]:       <mac address="fa:16:3e:e2:7c:96"/>
Nov 14 22:08:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="tap2918fcad-5d"/>
Nov 14 22:08:48 user nova-compute[76815]:     </interface>
Nov 14 22:08:48 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:48 user nova-compute[76815]:       <mac address="fa:16:3e:8d:b4:f4"/>
Nov 14 22:08:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="tap9e313244-7f"/>
Nov 14 22:08:48 user nova-compute[76815]:     </interface>
Nov 14 22:08:48 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:08:48 user nova-compute[76815]:       <mac address="fa:16:3e:ad:29:b8"/>
Nov 14 22:08:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:08:48 user nova-compute[76815]:       <target dev="tapf266fb6d-02"/>
Nov 14 22:08:48 user nova-compute[76815]:     </interface>
Nov 14 22:08:48 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:08:48 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/13d9a6bb-bfe4-46b2-977b-4f38b746bbfa/console.log" append="off"/>
Nov 14 22:08:48 user nova-compute[76815]:     </serial>
Nov 14 22:08:48 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:08:48 user nova-compute[76815]:     <video>
Nov 14 22:08:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:08:48 user nova-compute[76815]:     </video>
Nov 14 22:08:48 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:08:48 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:08:48 user nova-compute[76815]:     </rng>
Nov 14 22:08:48 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:08:48 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:08:48 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:08:48 user nova-compute[76815]:     </memballoon>
Nov 14 22:08:48 user nova-compute[76815]:   </devices>
Nov 14 22:08:48 user nova-compute[76815]: </domain>
Nov 14 22:08:48 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:cb:e6,bridge_name='br-int',has_traffic_filtering=True,id=891499b5-a743-47f5-be77-20fd703dba98,network=Network(3cfd9c53-400c-4d7e-a306-229b88b184ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891499b5-a7') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:cb:e6,bridge_name='br-int',has_traffic_filtering=True,id=891499b5-a743-47f5-be77-20fd703dba98,network=Network(3cfd9c53-400c-4d7e-a306-229b88b184ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891499b5-a7') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd20089b6-2b7b-5adb-a387-dfb8d21e54b3', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap891499b5-a7, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap891499b5-a7, col_values=(('qos', UUID('5a913889-834f-449d-ba81-dc6856218752')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap891499b5-a7, col_values=(('external_ids', {'iface-id': '891499b5-a743-47f5-be77-20fd703dba98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:cb:e6', 'vm-uuid': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: INFO os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:cb:e6,bridge_name='br-int',has_traffic_filtering=True,id=891499b5-a743-47f5-be77-20fd703dba98,network=Network(3cfd9c53-400c-4d7e-a306-229b88b184ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891499b5-a7')
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:c6,bridge_name='br-int',has_traffic_filtering=True,id=faee4c11-33ce-44e5-a8a6-761459aed964,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfaee4c11-33') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:c6,bridge_name='br-int',has_traffic_filtering=True,id=faee4c11-33ce-44e5-a8a6-761459aed964,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfaee4c11-33') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26a7e62a-c5fa-538e-a429-9eb775eb4c27', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfaee4c11-33, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfaee4c11-33, col_values=(('qos', UUID('12973b81-00f1-4d2b-9327-c10e335ca4dd')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfaee4c11-33, col_values=(('external_ids', {'iface-id': 'faee4c11-33ce-44e5-a8a6-761459aed964', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:21:c6', 'vm-uuid': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: INFO os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:c6,bridge_name='br-int',has_traffic_filtering=True,id=faee4c11-33ce-44e5-a8a6-761459aed964,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfaee4c11-33')
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=f81937c3-cffb-4cb0-8b83-590ed631118f,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81937c3-cf') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=f81937c3-cffb-4cb0-8b83-590ed631118f,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81937c3-cf') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62dfbdd8-1191-506f-a9e8-b1ce346385b5', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf81937c3-cf, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf81937c3-cf, col_values=(('qos', UUID('c46f9b66-d0b8-4cf2-9902-a30c977953a6')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf81937c3-cf, col_values=(('external_ids', {'iface-id': 'f81937c3-cffb-4cb0-8b83-590ed631118f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:a2:b5', 'vm-uuid': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: INFO os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=f81937c3-cffb-4cb0-8b83-590ed631118f,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81937c3-cf')
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:45,bridge_name='br-int',has_traffic_filtering=True,id=6b74bfc3-a532-4083-959f-fe3d0ad3ebf5,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74bfc3-a5') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:45,bridge_name='br-int',has_traffic_filtering=True,id=6b74bfc3-a532-4083-959f-fe3d0ad3ebf5,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74bfc3-a5') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9ed0a1d-4f25-58b3-ba10-f3f0e7f608f7', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b74bfc3-a5, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b74bfc3-a5, col_values=(('qos', UUID('46f230bf-d0c0-47b5-ae67-9cbe4ebfe99e')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b74bfc3-a5, col_values=(('external_ids', {'iface-id': '6b74bfc3-a532-4083-959f-fe3d0ad3ebf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:35:45', 'vm-uuid': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: INFO os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:45,bridge_name='br-int',has_traffic_filtering=True,id=6b74bfc3-a532-4083-959f-fe3d0ad3ebf5,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74bfc3-a5')
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7c:96,bridge_name='br-int',has_traffic_filtering=True,id=2918fcad-5d37-4682-945e-c5cda02bcced,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2918fcad-5d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7c:96,bridge_name='br-int',has_traffic_filtering=True,id=2918fcad-5d37-4682-945e-c5cda02bcced,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2918fcad-5d') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b32d7132-022d-56b9-bdfe-ef9327de95d9', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2918fcad-5d, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2918fcad-5d, col_values=(('qos', UUID('e20a0801-418d-4bae-9344-23c91804790b')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2918fcad-5d, col_values=(('external_ids', {'iface-id': '2918fcad-5d37-4682-945e-c5cda02bcced', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:7c:96', 'vm-uuid': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: INFO os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7c:96,bridge_name='br-int',has_traffic_filtering=True,id=2918fcad-5d37-4682-945e-c5cda02bcced,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2918fcad-5d')
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b4:f4,bridge_name='br-int',has_traffic_filtering=True,id=9e313244-7f65-4a20-b837-eaa4c9851d0f,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e313244-7f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b4:f4,bridge_name='br-int',has_traffic_filtering=True,id=9e313244-7f65-4a20-b837-eaa4c9851d0f,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e313244-7f') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-bf7af67d-502d-400f-84fa-53421ce027f8 req-6fe0c69b-5cbb-4b12-a36c-a250c73f4592 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf7af67d-502d-400f-84fa-53421ce027f8 req-6fe0c69b-5cbb-4b12-a36c-a250c73f4592 service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf7af67d-502d-400f-84fa-53421ce027f8 req-6fe0c69b-5cbb-4b12-a36c-a250c73f4592 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf7af67d-502d-400f-84fa-53421ce027f8 req-6fe0c69b-5cbb-4b12-a36c-a250c73f4592 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-bf7af67d-502d-400f-84fa-53421ce027f8 req-6fe0c69b-5cbb-4b12-a36c-a250c73f4592 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:50 user nova-compute[76815]: WARNING nova.compute.manager [req-bf7af67d-502d-400f-84fa-53421ce027f8 req-6fe0c69b-5cbb-4b12-a36c-a250c73f4592 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-181fec50-aed8-46cf-8926-666ba8b4ccad for instance with vm_state building and task_state spawning.
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99997816-38a8-561d-9990-3dc180aff361', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e313244-7f, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e313244-7f, col_values=(('qos', UUID('3f26319e-0a2b-4d3b-aa7b-0561891fc4b1')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e313244-7f, col_values=(('external_ids', {'iface-id': '9e313244-7f65-4a20-b837-eaa4c9851d0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:b4:f4', 'vm-uuid': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: INFO os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b4:f4,bridge_name='br-int',has_traffic_filtering=True,id=9e313244-7f65-4a20-b837-eaa4c9851d0f,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e313244-7f')
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:b8,bridge_name='br-int',has_traffic_filtering=True,id=f266fb6d-022e-4ea5-aa6b-9837fe489168,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf266fb6d-02') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:b8,bridge_name='br-int',has_traffic_filtering=True,id=f266fb6d-022e-4ea5-aa6b-9837fe489168,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf266fb6d-02') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-e5e90d9d-1c6e-4f57-b2f8-9483285aa1db req-94a8d1fb-784c-4658-80b7-9e64243daf3c service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5e90d9d-1c6e-4f57-b2f8-9483285aa1db req-94a8d1fb-784c-4658-80b7-9e64243daf3c service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5e90d9d-1c6e-4f57-b2f8-9483285aa1db req-94a8d1fb-784c-4658-80b7-9e64243daf3c service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5e90d9d-1c6e-4f57-b2f8-9483285aa1db req-94a8d1fb-784c-4658-80b7-9e64243daf3c service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-e5e90d9d-1c6e-4f57-b2f8-9483285aa1db req-94a8d1fb-784c-4658-80b7-9e64243daf3c service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:50 user nova-compute[76815]: WARNING nova.compute.manager [req-e5e90d9d-1c6e-4f57-b2f8-9483285aa1db req-94a8d1fb-784c-4658-80b7-9e64243daf3c service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-00031166-05b9-413e-814b-3d9ca500dce6 for instance with vm_state building and task_state spawning.
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4dcf847-629b-54f8-8bae-ba3fca45f064', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf266fb6d-02, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf266fb6d-02, col_values=(('qos', UUID('e67dbe43-0efa-42c9-94c1-f38bd12e1dcd')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf266fb6d-02, col_values=(('external_ids', {'iface-id': 'f266fb6d-022e-4ea5-aa6b-9837fe489168', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:29:b8', 'vm-uuid': '13d9a6bb-bfe4-46b2-977b-4f38b746bbfa'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: INFO os_vif [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:b8,bridge_name='br-int',has_traffic_filtering=True,id=f266fb6d-022e-4ea5-aa6b-9837fe489168,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf266fb6d-02')
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] No BDM found with device name hda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] No VIF found with MAC fa:16:3e:b8:cb:e6, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] No VIF found with MAC fa:16:3e:e2:7c:96, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:08:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Using config drive
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Creating config drive at /opt/stack/data/nova/instances/13d9a6bb-bfe4-46b2-977b-4f38b746bbfa/disk.config
Nov 14 22:08:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/13d9a6bb-bfe4-46b2-977b-4f38b746bbfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxeaa0e53 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-8db1dde1-c06c-46f7-80af-bdde2d5e5c1c req-7a27d999-4b64-49cb-aa1e-5cebf75c03a7 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8db1dde1-c06c-46f7-80af-bdde2d5e5c1c req-7a27d999-4b64-49cb-aa1e-5cebf75c03a7 service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8db1dde1-c06c-46f7-80af-bdde2d5e5c1c req-7a27d999-4b64-49cb-aa1e-5cebf75c03a7 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8db1dde1-c06c-46f7-80af-bdde2d5e5c1c req-7a27d999-4b64-49cb-aa1e-5cebf75c03a7 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-8db1dde1-c06c-46f7-80af-bdde2d5e5c1c req-7a27d999-4b64-49cb-aa1e-5cebf75c03a7 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:51 user nova-compute[76815]: WARNING nova.compute.manager [req-8db1dde1-c06c-46f7-80af-bdde2d5e5c1c req-7a27d999-4b64-49cb-aa1e-5cebf75c03a7 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-a2da1829-8bd3-4b37-85b1-2df590321e79 for instance with vm_state building and task_state spawning.
Nov 14 22:08:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/13d9a6bb-bfe4-46b2-977b-4f38b746bbfa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxeaa0e53" returned: 0 in 0.049s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:52 user nova-compute[76815]: WARNING nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-181fec50-aed8-46cf-8926-666ba8b4ccad for instance with vm_state building and task_state spawning.
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:52 user nova-compute[76815]: WARNING nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 for instance with vm_state building and task_state spawning.
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:52 user nova-compute[76815]: WARNING nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 for instance with vm_state building and task_state spawning.
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:52 user nova-compute[76815]: WARNING nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-8ef50e3e-aebc-4586-8e02-95e24035c65a for instance with vm_state building and task_state spawning.
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:52 user nova-compute[76815]: WARNING nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-8ef50e3e-aebc-4586-8e02-95e24035c65a for instance with vm_state building and task_state spawning.
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:52 user nova-compute[76815]: WARNING nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 for instance with vm_state building and task_state spawning.
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:52 user nova-compute[76815]: WARNING nova.compute.manager [req-50bb2bed-dae0-479e-bb6a-e089b4aae93e req-39410372-143f-43fa-9ccf-62f0a2651e3b service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 for instance with vm_state building and task_state spawning.
Nov 14 22:08:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-30ed77cb-9d54-4759-bd2d-60ede7c2578e req-c6a7eff3-0862-49d4-be96-54c696ff6218 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-30ed77cb-9d54-4759-bd2d-60ede7c2578e req-c6a7eff3-0862-49d4-be96-54c696ff6218 service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-30ed77cb-9d54-4759-bd2d-60ede7c2578e req-c6a7eff3-0862-49d4-be96-54c696ff6218 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-30ed77cb-9d54-4759-bd2d-60ede7c2578e req-c6a7eff3-0862-49d4-be96-54c696ff6218 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-30ed77cb-9d54-4759-bd2d-60ede7c2578e req-c6a7eff3-0862-49d4-be96-54c696ff6218 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:52 user nova-compute[76815]: WARNING nova.compute.manager [req-30ed77cb-9d54-4759-bd2d-60ede7c2578e req-c6a7eff3-0862-49d4-be96-54c696ff6218 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-00031166-05b9-413e-814b-3d9ca500dce6 for instance with vm_state building and task_state spawning.
Nov 14 22:08:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba822410-075f-4b81-9715-da5ce8394547 req-b6040af4-1c29-4416-9d73-6e76411ec3a0 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba822410-075f-4b81-9715-da5ce8394547 req-b6040af4-1c29-4416-9d73-6e76411ec3a0 service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba822410-075f-4b81-9715-da5ce8394547 req-b6040af4-1c29-4416-9d73-6e76411ec3a0 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba822410-075f-4b81-9715-da5ce8394547 req-b6040af4-1c29-4416-9d73-6e76411ec3a0 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba822410-075f-4b81-9715-da5ce8394547 req-b6040af4-1c29-4416-9d73-6e76411ec3a0 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:53 user nova-compute[76815]: WARNING nova.compute.manager [req-ba822410-075f-4b81-9715-da5ce8394547 req-b6040af4-1c29-4416-9d73-6e76411ec3a0 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-a2da1829-8bd3-4b37-85b1-2df590321e79 for instance with vm_state building and task_state spawning.
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:54 user nova-compute[76815]: WARNING nova.compute.manager [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee for instance with vm_state building and task_state spawning.
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:54 user nova-compute[76815]: WARNING nova.compute.manager [req-81d0ed38-338e-4330-901b-281fd7d817e3 req-4c7026ae-4a07-480c-8b62-9b4926f2ba94 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee for instance with vm_state building and task_state spawning.
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:54 user nova-compute[76815]: WARNING nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-891499b5-a743-47f5-be77-20fd703dba98 for instance with vm_state building and task_state spawning.
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:54 user nova-compute[76815]: WARNING nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-891499b5-a743-47f5-be77-20fd703dba98 for instance with vm_state building and task_state spawning.
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:54 user nova-compute[76815]: WARNING nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-faee4c11-33ce-44e5-a8a6-761459aed964 for instance with vm_state building and task_state spawning.
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:54 user nova-compute[76815]: WARNING nova.compute.manager [req-62286287-0b07-42c2-9b13-4bda5d7c2498 req-2cb005d3-1028-4451-a43f-65ba1e9c173c service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-faee4c11-33ce-44e5-a8a6-761459aed964 for instance with vm_state building and task_state spawning.
Nov 14 22:08:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:08:55 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance spawned successfully.
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:55 user nova-compute[76815]: INFO nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Took 14.74 seconds to spawn the instance on the hypervisor.
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:08:55 user nova-compute[76815]: INFO nova.compute.manager [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Took 36.07 seconds to build instance.
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-83f0b297-3301-4728-800d-8551af00c7a3 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "38304882-101f-43c4-8c18-028c609924d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.294s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:55 user nova-compute[76815]: WARNING nova.compute.manager [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-f81937c3-cffb-4cb0-8b83-590ed631118f for instance with vm_state building and task_state spawning.
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:55 user nova-compute[76815]: WARNING nova.compute.manager [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-f81937c3-cffb-4cb0-8b83-590ed631118f for instance with vm_state building and task_state spawning.
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:55 user nova-compute[76815]: WARNING nova.compute.manager [req-5eadad78-b41b-4c15-8974-81dcf7441100 req-a9cd1650-3149-44ea-8566-971561057ec2 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-9e313244-7f65-4a20-b837-eaa4c9851d0f for instance with vm_state building and task_state spawning.
Nov 14 22:08:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:56 user nova-compute[76815]: WARNING nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 for instance with vm_state building and task_state spawning.
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:56 user nova-compute[76815]: WARNING nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 for instance with vm_state building and task_state spawning.
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:56 user nova-compute[76815]: WARNING nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 for instance with vm_state building and task_state spawning.
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:56 user nova-compute[76815]: WARNING nova.compute.manager [req-8ce00eb0-bbbd-4f4b-a959-519211a41825 req-09e573ad-a782-4300-a077-1539f48bee25 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 for instance with vm_state building and task_state spawning.
Nov 14 22:08:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:56 user nova-compute[76815]: WARNING nova.compute.manager [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-2918fcad-5d37-4682-945e-c5cda02bcced for instance with vm_state building and task_state spawning.
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:56 user nova-compute[76815]: WARNING nova.compute.manager [req-abd85069-2ec3-42c8-95f6-e5a3e0b69444 req-e07dfae8-b995-412c-87b6-d85ef16b2c66 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-2918fcad-5d37-4682-945e-c5cda02bcced for instance with vm_state building and task_state spawning.
Nov 14 22:08:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-609de048-5611-4c77-ac9e-b2f7a3e4b7ce req-a66f19e8-8088-4d69-bb54-200e3e5295a6 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-609de048-5611-4c77-ac9e-b2f7a3e4b7ce req-a66f19e8-8088-4d69-bb54-200e3e5295a6 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-609de048-5611-4c77-ac9e-b2f7a3e4b7ce req-a66f19e8-8088-4d69-bb54-200e3e5295a6 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-609de048-5611-4c77-ac9e-b2f7a3e4b7ce req-a66f19e8-8088-4d69-bb54-200e3e5295a6 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-609de048-5611-4c77-ac9e-b2f7a3e4b7ce req-a66f19e8-8088-4d69-bb54-200e3e5295a6 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:08:57 user nova-compute[76815]: WARNING nova.compute.manager [req-609de048-5611-4c77-ac9e-b2f7a3e4b7ce req-a66f19e8-8088-4d69-bb54-200e3e5295a6 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-9e313244-7f65-4a20-b837-eaa4c9851d0f for instance with vm_state building and task_state spawning.
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:08:57 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance spawned successfully.
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:08:57 user nova-compute[76815]: INFO nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Took 16.43 seconds to spawn the instance on the hypervisor.
Nov 14 22:08:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:08:58 user nova-compute[76815]: INFO nova.compute.manager [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Took 37.26 seconds to build instance.
Nov 14 22:08:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-531af8e0-d199-466a-94e2-76992253296b tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.427s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:09:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:09:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:09:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:09:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:09:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:09:19 user nova-compute[76815]: INFO nova.compute.claims [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Claim successful on node user
Nov 14 22:09:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:09:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:09:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.policy [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b7935d9b21649d6a22c6b8700fbee4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c9996c7ec44bdf912e9dfc6cd852a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:09:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Creating image(s)
Nov 14 22:09:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "/opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "/opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.285s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:20 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Successfully created port: b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.213s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk 1073741824" returned: 0 in 0.052s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.201s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Successfully updated port: b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Cannot resize image /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Ensure instance console log exists: /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "refresh_cache-4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquired lock "refresh_cache-4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-b6a747ad-158e-4443-a3df-2af1c8b2d4a4 req-21f151f7-7f9f-4e3c-9fb4-0e3d6af2ed55 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received event network-changed-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-b6a747ad-158e-4443-a3df-2af1c8b2d4a4 req-21f151f7-7f9f-4e3c-9fb4-0e3d6af2ed55 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Refreshing instance network info cache due to event network-changed-b6d1ceb1-c884-47cd-bb11-cf902fb090d3. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b6a747ad-158e-4443-a3df-2af1c8b2d4a4 req-21f151f7-7f9f-4e3c-9fb4-0e3d6af2ed55 service nova] Acquiring lock "refresh_cache-4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Updating instance_info_cache with network_info: [{"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Releasing lock "refresh_cache-4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Instance network_info: |[{"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b6a747ad-158e-4443-a3df-2af1c8b2d4a4 req-21f151f7-7f9f-4e3c-9fb4-0e3d6af2ed55 service nova] Acquired lock "refresh_cache-4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.network.neutron [req-b6a747ad-158e-4443-a3df-2af1c8b2d4a4 req-21f151f7-7f9f-4e3c-9fb4-0e3d6af2ed55 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Refreshing network info cache for port b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Start _get_guest_xml network_info=[{"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:09:21 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:09:21 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-25609801',display_name='tempest-VolumesActionsTest-instance-25609801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-25609801',id=11,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9c9996c7ec44bdf912e9dfc6cd852a0',ramdisk_id='',reservation_id='r-g0zk0rcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-439034333',owner_user_name='tempest-VolumesActionsTest-439034333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:09:20Z,user_data=None,user_id='4b7935d9b21649d6a22c6b8700fbee4f',uuid=4f27c15c-c2d3-4a4c-af05-3a91b4fe3033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converting VIF {"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e9:f6,bridge_name='br-int',has_traffic_filtering=True,id=b6d1ceb1-c884-47cd-bb11-cf902fb090d3,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d1ceb1-c8') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.objects.instance [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:09:21 user nova-compute[76815]:   <uuid>4f27c15c-c2d3-4a4c-af05-3a91b4fe3033</uuid>
Nov 14 22:09:21 user nova-compute[76815]:   <name>instance-0000000b</name>
Nov 14 22:09:21 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:09:21 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:09:21 user nova-compute[76815]:   <metadata>
Nov 14 22:09:21 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:09:21 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:09:21 user nova-compute[76815]:       <nova:name>tempest-VolumesActionsTest-instance-25609801</nova:name>
Nov 14 22:09:21 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:09:21</nova:creationTime>
Nov 14 22:09:21 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:09:21 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:09:21 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:09:21 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:09:21 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:09:21 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:09:21 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:09:21 user nova-compute[76815]:       <nova:owner>
Nov 14 22:09:21 user nova-compute[76815]:         <nova:user uuid="4b7935d9b21649d6a22c6b8700fbee4f">tempest-VolumesActionsTest-439034333-project-member</nova:user>
Nov 14 22:09:21 user nova-compute[76815]:         <nova:project uuid="c9c9996c7ec44bdf912e9dfc6cd852a0">tempest-VolumesActionsTest-439034333</nova:project>
Nov 14 22:09:21 user nova-compute[76815]:       </nova:owner>
Nov 14 22:09:21 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:09:21 user nova-compute[76815]:       <nova:ports>
Nov 14 22:09:21 user nova-compute[76815]:         <nova:port uuid="b6d1ceb1-c884-47cd-bb11-cf902fb090d3">
Nov 14 22:09:21 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 22:09:21 user nova-compute[76815]:         </nova:port>
Nov 14 22:09:21 user nova-compute[76815]:       </nova:ports>
Nov 14 22:09:21 user nova-compute[76815]:     </nova:instance>
Nov 14 22:09:21 user nova-compute[76815]:   </metadata>
Nov 14 22:09:21 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:09:21 user nova-compute[76815]:     <system>
Nov 14 22:09:21 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:09:21 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:09:21 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:09:21 user nova-compute[76815]:       <entry name="serial">4f27c15c-c2d3-4a4c-af05-3a91b4fe3033</entry>
Nov 14 22:09:21 user nova-compute[76815]:       <entry name="uuid">4f27c15c-c2d3-4a4c-af05-3a91b4fe3033</entry>
Nov 14 22:09:21 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:09:21 user nova-compute[76815]:     </system>
Nov 14 22:09:21 user nova-compute[76815]:   </sysinfo>
Nov 14 22:09:21 user nova-compute[76815]:   <os>
Nov 14 22:09:21 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:09:21 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:09:21 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:09:21 user nova-compute[76815]:   </os>
Nov 14 22:09:21 user nova-compute[76815]:   <features>
Nov 14 22:09:21 user nova-compute[76815]:     <acpi/>
Nov 14 22:09:21 user nova-compute[76815]:     <apic/>
Nov 14 22:09:21 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:09:21 user nova-compute[76815]:   </features>
Nov 14 22:09:21 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:09:21 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:09:21 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:09:21 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:09:21 user nova-compute[76815]:   </clock>
Nov 14 22:09:21 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:09:21 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:09:21 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:09:21 user nova-compute[76815]:   </cpu>
Nov 14 22:09:21 user nova-compute[76815]:   <devices>
Nov 14 22:09:21 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:09:21 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:09:21 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk"/>
Nov 14 22:09:21 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:09:21 user nova-compute[76815]:     </disk>
Nov 14 22:09:21 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:09:21 user nova-compute[76815]:       <mac address="fa:16:3e:2f:e9:f6"/>
Nov 14 22:09:21 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:09:21 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:09:21 user nova-compute[76815]:       <target dev="tapb6d1ceb1-c8"/>
Nov 14 22:09:21 user nova-compute[76815]:     </interface>
Nov 14 22:09:21 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:09:21 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/console.log" append="off"/>
Nov 14 22:09:21 user nova-compute[76815]:     </serial>
Nov 14 22:09:21 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:09:21 user nova-compute[76815]:     <video>
Nov 14 22:09:21 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:09:21 user nova-compute[76815]:     </video>
Nov 14 22:09:21 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:09:21 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:09:21 user nova-compute[76815]:     </rng>
Nov 14 22:09:21 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:09:21 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:09:21 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:09:21 user nova-compute[76815]:     </memballoon>
Nov 14 22:09:21 user nova-compute[76815]:   </devices>
Nov 14 22:09:21 user nova-compute[76815]: </domain>
Nov 14 22:09:21 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-25609801',display_name='tempest-VolumesActionsTest-instance-25609801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-25609801',id=11,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9c9996c7ec44bdf912e9dfc6cd852a0',ramdisk_id='',reservation_id='r-g0zk0rcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-439034333',owner_user_name='tempest-VolumesActionsTest-439034333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:09:20Z,user_data=None,user_id='4b7935d9b21649d6a22c6b8700fbee4f',uuid=4f27c15c-c2d3-4a4c-af05-3a91b4fe3033,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converting VIF {"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e9:f6,bridge_name='br-int',has_traffic_filtering=True,id=b6d1ceb1-c884-47cd-bb11-cf902fb090d3,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d1ceb1-c8') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG os_vif [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e9:f6,bridge_name='br-int',has_traffic_filtering=True,id=b6d1ceb1-c884-47cd-bb11-cf902fb090d3,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d1ceb1-c8') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b1afac7-b365-505f-b394-69f9f605d32c', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6d1ceb1-c8, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6d1ceb1-c8, col_values=(('qos', UUID('0a75a959-c055-464c-a887-90658e9ec782')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6d1ceb1-c8, col_values=(('external_ids', {'iface-id': 'b6d1ceb1-c884-47cd-bb11-cf902fb090d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:e9:f6', 'vm-uuid': '4f27c15c-c2d3-4a4c-af05-3a91b4fe3033'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:21 user nova-compute[76815]: INFO os_vif [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e9:f6,bridge_name='br-int',has_traffic_filtering=True,id=b6d1ceb1-c884-47cd-bb11-cf902fb090d3,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d1ceb1-c8')
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:09:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] No VIF found with MAC fa:16:3e:2f:e9:f6, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:09:22 user nova-compute[76815]: DEBUG nova.network.neutron [req-b6a747ad-158e-4443-a3df-2af1c8b2d4a4 req-21f151f7-7f9f-4e3c-9fb4-0e3d6af2ed55 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Updated VIF entry in instance network info cache for port b6d1ceb1-c884-47cd-bb11-cf902fb090d3. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:09:22 user nova-compute[76815]: DEBUG nova.network.neutron [req-b6a747ad-158e-4443-a3df-2af1c8b2d4a4 req-21f151f7-7f9f-4e3c-9fb4-0e3d6af2ed55 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Updating instance_info_cache with network_info: [{"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b6a747ad-158e-4443-a3df-2af1c8b2d4a4 req-21f151f7-7f9f-4e3c-9fb4-0e3d6af2ed55 service nova] Releasing lock "refresh_cache-4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-f1b1d2ee-3d2e-4a24-812d-4c3f8e46addc req-4eb582eb-bf91-4df6-94bd-1de0c7563511 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received event network-vif-plugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f1b1d2ee-3d2e-4a24-812d-4c3f8e46addc req-4eb582eb-bf91-4df6-94bd-1de0c7563511 service nova] Acquiring lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f1b1d2ee-3d2e-4a24-812d-4c3f8e46addc req-4eb582eb-bf91-4df6-94bd-1de0c7563511 service nova] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f1b1d2ee-3d2e-4a24-812d-4c3f8e46addc req-4eb582eb-bf91-4df6-94bd-1de0c7563511 service nova] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-f1b1d2ee-3d2e-4a24-812d-4c3f8e46addc req-4eb582eb-bf91-4df6-94bd-1de0c7563511 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] No waiting events found dispatching network-vif-plugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:09:23 user nova-compute[76815]: WARNING nova.compute.manager [req-f1b1d2ee-3d2e-4a24-812d-4c3f8e46addc req-4eb582eb-bf91-4df6-94bd-1de0c7563511 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received unexpected event network-vif-plugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 for instance with vm_state building and task_state spawning.
Nov 14 22:09:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:09:25 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Instance spawned successfully.
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-32788e33-e471-4d76-8774-b3f6c903c033 req-4799c621-2105-4309-997d-31f30e8e0710 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received event network-vif-plugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-32788e33-e471-4d76-8774-b3f6c903c033 req-4799c621-2105-4309-997d-31f30e8e0710 service nova] Acquiring lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-32788e33-e471-4d76-8774-b3f6c903c033 req-4799c621-2105-4309-997d-31f30e8e0710 service nova] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-32788e33-e471-4d76-8774-b3f6c903c033 req-4799c621-2105-4309-997d-31f30e8e0710 service nova] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-32788e33-e471-4d76-8774-b3f6c903c033 req-4799c621-2105-4309-997d-31f30e8e0710 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] No waiting events found dispatching network-vif-plugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:09:25 user nova-compute[76815]: WARNING nova.compute.manager [req-32788e33-e471-4d76-8774-b3f6c903c033 req-4799c621-2105-4309-997d-31f30e8e0710 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received unexpected event network-vif-plugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 for instance with vm_state building and task_state spawning.
Nov 14 22:09:25 user nova-compute[76815]: INFO nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 14 22:09:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:09:25 user nova-compute[76815]: INFO nova.compute.manager [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Took 6.04 seconds to build instance.
Nov 14 22:09:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7ec9a58c-318e-4113-ba19-f052ddb11651 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.144s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "adac433a-262e-49c1-b7c6-cc99dc88afa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:26 user nova-compute[76815]: DEBUG nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:09:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:26 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:09:26 user nova-compute[76815]: INFO nova.compute.claims [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Claim successful on node user
Nov 14 22:09:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:09:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.policy [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '494ca9737a354c719f4b286053f7a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde13b6fb9174200aecd89b17c2b675e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:09:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Creating image(s)
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "/opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "/opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "/opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.213s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Successfully created port: 2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.261s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk 1073741824" returned: 0 in 0.054s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Cannot resize image /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Ensure instance console log exists: /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Successfully updated port: 2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "refresh_cache-adac433a-262e-49c1-b7c6-cc99dc88afa3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquired lock "refresh_cache-adac433a-262e-49c1-b7c6-cc99dc88afa3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-f7f0fddd-2410-41fc-bb5a-d26bb34295fc req-2f9ce40f-6385-4b62-a6a5-78d5b46f4634 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received event network-changed-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-f7f0fddd-2410-41fc-bb5a-d26bb34295fc req-2f9ce40f-6385-4b62-a6a5-78d5b46f4634 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Refreshing instance network info cache due to event network-changed-2de64b24-7921-4b71-9443-8b945b2058c6. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7f0fddd-2410-41fc-bb5a-d26bb34295fc req-2f9ce40f-6385-4b62-a6a5-78d5b46f4634 service nova] Acquiring lock "refresh_cache-adac433a-262e-49c1-b7c6-cc99dc88afa3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Updating instance_info_cache with network_info: [{"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Releasing lock "refresh_cache-adac433a-262e-49c1-b7c6-cc99dc88afa3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Instance network_info: |[{"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7f0fddd-2410-41fc-bb5a-d26bb34295fc req-2f9ce40f-6385-4b62-a6a5-78d5b46f4634 service nova] Acquired lock "refresh_cache-adac433a-262e-49c1-b7c6-cc99dc88afa3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-f7f0fddd-2410-41fc-bb5a-d26bb34295fc req-2f9ce40f-6385-4b62-a6a5-78d5b46f4634 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Refreshing network info cache for port 2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Start _get_guest_xml network_info=[{"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:09:29 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:09:29 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1296427425',display_name='tempest-ServersNegativeTestJSON-server-1296427425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1296427425',id=12,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bde13b6fb9174200aecd89b17c2b675e',ramdisk_id='',reservation_id='r-78jjglu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1003137324',owner_user_name='tempest-ServersNegativeTestJSON-1003137324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:09:27Z,user_data=None,user_id='494ca9737a354c719f4b286053f7a1b4',uuid=adac433a-262e-49c1-b7c6-cc99dc88afa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converting VIF {"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c5:c3,bridge_name='br-int',has_traffic_filtering=True,id=2de64b24-7921-4b71-9443-8b945b2058c6,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de64b24-79') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.objects.instance [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lazy-loading 'pci_devices' on Instance uuid adac433a-262e-49c1-b7c6-cc99dc88afa3 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:09:29 user nova-compute[76815]:   <uuid>adac433a-262e-49c1-b7c6-cc99dc88afa3</uuid>
Nov 14 22:09:29 user nova-compute[76815]:   <name>instance-0000000c</name>
Nov 14 22:09:29 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:09:29 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:09:29 user nova-compute[76815]:   <metadata>
Nov 14 22:09:29 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:09:29 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:09:29 user nova-compute[76815]:       <nova:name>tempest-ServersNegativeTestJSON-server-1296427425</nova:name>
Nov 14 22:09:29 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:09:29</nova:creationTime>
Nov 14 22:09:29 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:09:29 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:09:29 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:09:29 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:09:29 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:09:29 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:09:29 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:09:29 user nova-compute[76815]:       <nova:owner>
Nov 14 22:09:29 user nova-compute[76815]:         <nova:user uuid="494ca9737a354c719f4b286053f7a1b4">tempest-ServersNegativeTestJSON-1003137324-project-member</nova:user>
Nov 14 22:09:29 user nova-compute[76815]:         <nova:project uuid="bde13b6fb9174200aecd89b17c2b675e">tempest-ServersNegativeTestJSON-1003137324</nova:project>
Nov 14 22:09:29 user nova-compute[76815]:       </nova:owner>
Nov 14 22:09:29 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:09:29 user nova-compute[76815]:       <nova:ports>
Nov 14 22:09:29 user nova-compute[76815]:         <nova:port uuid="2de64b24-7921-4b71-9443-8b945b2058c6">
Nov 14 22:09:29 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 22:09:29 user nova-compute[76815]:         </nova:port>
Nov 14 22:09:29 user nova-compute[76815]:       </nova:ports>
Nov 14 22:09:29 user nova-compute[76815]:     </nova:instance>
Nov 14 22:09:29 user nova-compute[76815]:   </metadata>
Nov 14 22:09:29 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:09:29 user nova-compute[76815]:     <system>
Nov 14 22:09:29 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:09:29 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:09:29 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:09:29 user nova-compute[76815]:       <entry name="serial">adac433a-262e-49c1-b7c6-cc99dc88afa3</entry>
Nov 14 22:09:29 user nova-compute[76815]:       <entry name="uuid">adac433a-262e-49c1-b7c6-cc99dc88afa3</entry>
Nov 14 22:09:29 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:09:29 user nova-compute[76815]:     </system>
Nov 14 22:09:29 user nova-compute[76815]:   </sysinfo>
Nov 14 22:09:29 user nova-compute[76815]:   <os>
Nov 14 22:09:29 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:09:29 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:09:29 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:09:29 user nova-compute[76815]:   </os>
Nov 14 22:09:29 user nova-compute[76815]:   <features>
Nov 14 22:09:29 user nova-compute[76815]:     <acpi/>
Nov 14 22:09:29 user nova-compute[76815]:     <apic/>
Nov 14 22:09:29 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:09:29 user nova-compute[76815]:   </features>
Nov 14 22:09:29 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:09:29 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:09:29 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:09:29 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:09:29 user nova-compute[76815]:   </clock>
Nov 14 22:09:29 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:09:29 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:09:29 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:09:29 user nova-compute[76815]:   </cpu>
Nov 14 22:09:29 user nova-compute[76815]:   <devices>
Nov 14 22:09:29 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:09:29 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:09:29 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk"/>
Nov 14 22:09:29 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:09:29 user nova-compute[76815]:     </disk>
Nov 14 22:09:29 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:09:29 user nova-compute[76815]:       <mac address="fa:16:3e:33:c5:c3"/>
Nov 14 22:09:29 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:09:29 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:09:29 user nova-compute[76815]:       <target dev="tap2de64b24-79"/>
Nov 14 22:09:29 user nova-compute[76815]:     </interface>
Nov 14 22:09:29 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:09:29 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/console.log" append="off"/>
Nov 14 22:09:29 user nova-compute[76815]:     </serial>
Nov 14 22:09:29 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:09:29 user nova-compute[76815]:     <video>
Nov 14 22:09:29 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:09:29 user nova-compute[76815]:     </video>
Nov 14 22:09:29 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:09:29 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:09:29 user nova-compute[76815]:     </rng>
Nov 14 22:09:29 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:09:29 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:09:29 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:09:29 user nova-compute[76815]:     </memballoon>
Nov 14 22:09:29 user nova-compute[76815]:   </devices>
Nov 14 22:09:29 user nova-compute[76815]: </domain>
Nov 14 22:09:29 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1296427425',display_name='tempest-ServersNegativeTestJSON-server-1296427425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1296427425',id=12,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bde13b6fb9174200aecd89b17c2b675e',ramdisk_id='',reservation_id='r-78jjglu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1003137324',owner_user_name='tempest-ServersNegativeTestJSON-1003137324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:09:27Z,user_data=None,user_id='494ca9737a354c719f4b286053f7a1b4',uuid=adac433a-262e-49c1-b7c6-cc99dc88afa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converting VIF {"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c5:c3,bridge_name='br-int',has_traffic_filtering=True,id=2de64b24-7921-4b71-9443-8b945b2058c6,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de64b24-79') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG os_vif [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c5:c3,bridge_name='br-int',has_traffic_filtering=True,id=2de64b24-7921-4b71-9443-8b945b2058c6,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de64b24-79') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55811282-cfee-5f53-8c88-d73ec91bd31b', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2de64b24-79, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2de64b24-79, col_values=(('qos', UUID('b4567d30-3cbe-4e4b-b7e1-c591547f7376')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2de64b24-79, col_values=(('external_ids', {'iface-id': '2de64b24-7921-4b71-9443-8b945b2058c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c5:c3', 'vm-uuid': 'adac433a-262e-49c1-b7c6-cc99dc88afa3'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:29 user nova-compute[76815]: INFO os_vif [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c5:c3,bridge_name='br-int',has_traffic_filtering=True,id=2de64b24-7921-4b71-9443-8b945b2058c6,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de64b24-79')
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] No VIF found with MAC fa:16:3e:33:c5:c3, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-45492d43-fc04-4805-8a6b-bde0dd1c49e0 req-f8d57329-66d4-4b5f-a04d-31acdb79f725 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-changed-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-45492d43-fc04-4805-8a6b-bde0dd1c49e0 req-f8d57329-66d4-4b5f-a04d-31acdb79f725 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Refreshing instance network info cache due to event network-changed-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45492d43-fc04-4805-8a6b-bde0dd1c49e0 req-f8d57329-66d4-4b5f-a04d-31acdb79f725 service nova] Acquiring lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45492d43-fc04-4805-8a6b-bde0dd1c49e0 req-f8d57329-66d4-4b5f-a04d-31acdb79f725 service nova] Acquired lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-45492d43-fc04-4805-8a6b-bde0dd1c49e0 req-f8d57329-66d4-4b5f-a04d-31acdb79f725 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Refreshing network info cache for port 01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-f7f0fddd-2410-41fc-bb5a-d26bb34295fc req-2f9ce40f-6385-4b62-a6a5-78d5b46f4634 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Updated VIF entry in instance network info cache for port 2de64b24-7921-4b71-9443-8b945b2058c6. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-f7f0fddd-2410-41fc-bb5a-d26bb34295fc req-2f9ce40f-6385-4b62-a6a5-78d5b46f4634 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Updating instance_info_cache with network_info: [{"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7f0fddd-2410-41fc-bb5a-d26bb34295fc req-2f9ce40f-6385-4b62-a6a5-78d5b46f4634 service nova] Releasing lock "refresh_cache-adac433a-262e-49c1-b7c6-cc99dc88afa3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-45492d43-fc04-4805-8a6b-bde0dd1c49e0 req-f8d57329-66d4-4b5f-a04d-31acdb79f725 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updated VIF entry in instance network info cache for port 01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-45492d43-fc04-4805-8a6b-bde0dd1c49e0 req-f8d57329-66d4-4b5f-a04d-31acdb79f725 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45492d43-fc04-4805-8a6b-bde0dd1c49e0 req-f8d57329-66d4-4b5f-a04d-31acdb79f725 service nova] Releasing lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-c093f00b-6a25-4e2a-bac6-06e5ceb6d857 req-1366842e-66d5-485e-9057-177185273fe0 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received event network-vif-plugged-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c093f00b-6a25-4e2a-bac6-06e5ceb6d857 req-1366842e-66d5-485e-9057-177185273fe0 service nova] Acquiring lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c093f00b-6a25-4e2a-bac6-06e5ceb6d857 req-1366842e-66d5-485e-9057-177185273fe0 service nova] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c093f00b-6a25-4e2a-bac6-06e5ceb6d857 req-1366842e-66d5-485e-9057-177185273fe0 service nova] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-c093f00b-6a25-4e2a-bac6-06e5ceb6d857 req-1366842e-66d5-485e-9057-177185273fe0 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] No waiting events found dispatching network-vif-plugged-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:09:30 user nova-compute[76815]: WARNING nova.compute.manager [req-c093f00b-6a25-4e2a-bac6-06e5ceb6d857 req-1366842e-66d5-485e-9057-177185273fe0 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received unexpected event network-vif-plugged-2de64b24-7921-4b71-9443-8b945b2058c6 for instance with vm_state building and task_state spawning.
Nov 14 22:09:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:09:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:09:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:09:32 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:09:32 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=6891MB free_disk=25.474239349365234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:32 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Instance spawned successfully.
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa63a8c9-eb7c-41d8-8cac-c255ae8fc35c req-e8ff45f7-92ed-4659-9a10-7a7db7a81a43 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received event network-vif-plugged-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa63a8c9-eb7c-41d8-8cac-c255ae8fc35c req-e8ff45f7-92ed-4659-9a10-7a7db7a81a43 service nova] Acquiring lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa63a8c9-eb7c-41d8-8cac-c255ae8fc35c req-e8ff45f7-92ed-4659-9a10-7a7db7a81a43 service nova] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa63a8c9-eb7c-41d8-8cac-c255ae8fc35c req-e8ff45f7-92ed-4659-9a10-7a7db7a81a43 service nova] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa63a8c9-eb7c-41d8-8cac-c255ae8fc35c req-e8ff45f7-92ed-4659-9a10-7a7db7a81a43 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] No waiting events found dispatching network-vif-plugged-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:09:32 user nova-compute[76815]: WARNING nova.compute.manager [req-aa63a8c9-eb7c-41d8-8cac-c255ae8fc35c req-e8ff45f7-92ed-4659-9a10-7a7db7a81a43 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received unexpected event network-vif-plugged-2de64b24-7921-4b71-9443-8b945b2058c6 for instance with vm_state building and task_state spawning.
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:09:33 user nova-compute[76815]: INFO nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bb235db0-61d3-4e29-9794-b7c181f074d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2629c515-bd23-4df8-bdfc-4e84c0c06e5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 16c58923-c97e-4148-af31-9609b9af5d80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 91830a3a-8395-4f82-81c3-6aec79a46c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ab3b7495-76be-421d-9843-af965b815413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 38304882-101f-43c4-8c18-028c609924d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance adac433a-262e-49c1-b7c6-cc99dc88afa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:09:33 user nova-compute[76815]: INFO nova.compute.manager [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Took 6.29 seconds to build instance.
Nov 14 22:09:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af43c62a-f942-412e-b9eb-d63a964489b5 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.391s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:09:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:09:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:09:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-673541ac-eca0-4bd4-b970-3266e66da831 req-bf5294a9-dace-4580-bbb3-6d58daed3bc4 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received event network-changed-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-673541ac-eca0-4bd4-b970-3266e66da831 req-bf5294a9-dace-4580-bbb3-6d58daed3bc4 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Refreshing instance network info cache due to event network-changed-26a0eb02-82ba-4263-899f-9d49359e9dd5. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:09:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-673541ac-eca0-4bd4-b970-3266e66da831 req-bf5294a9-dace-4580-bbb3-6d58daed3bc4 service nova] Acquiring lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-673541ac-eca0-4bd4-b970-3266e66da831 req-bf5294a9-dace-4580-bbb3-6d58daed3bc4 service nova] Acquired lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:42 user nova-compute[76815]: DEBUG nova.network.neutron [req-673541ac-eca0-4bd4-b970-3266e66da831 req-bf5294a9-dace-4580-bbb3-6d58daed3bc4 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Refreshing network info cache for port 26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:09:43 user nova-compute[76815]: DEBUG nova.network.neutron [req-673541ac-eca0-4bd4-b970-3266e66da831 req-bf5294a9-dace-4580-bbb3-6d58daed3bc4 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Updated VIF entry in instance network info cache for port 26a0eb02-82ba-4263-899f-9d49359e9dd5. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:09:43 user nova-compute[76815]: DEBUG nova.network.neutron [req-673541ac-eca0-4bd4-b970-3266e66da831 req-bf5294a9-dace-4580-bbb3-6d58daed3bc4 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Updating instance_info_cache with network_info: [{"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-673541ac-eca0-4bd4-b970-3266e66da831 req-bf5294a9-dace-4580-bbb3-6d58daed3bc4 service nova] Releasing lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lazy-loading 'flavor' on Instance uuid a3ba0d7d-48dd-4718-9447-fb632bd1e57b {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:44 user nova-compute[76815]: INFO nova.compute.manager [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Attaching volume f124d5f0-d226-4185-9f9e-57756d42f708 to /dev/vdb
Nov 14 22:09:44 user nova-compute[76815]: DEBUG os_brick.utils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e6c3ff-bbcb-4051-a105-654aecde1b7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4709924e-023a-42ae-885b-1ab0103b3f48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b4875f-5ccf-4869-9ee4-c46af17f1528]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[006e7064-c100-412f-8ef5-2c0de645c256]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:09:44 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:09:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c69bbe9-37ad-4214-87be-224486a9d2d4]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG os_brick.utils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:09:44 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Updating existing volume attachment record: 9b35ef99-07b7-46b5-bd94-2c762a7a3470 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:09:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-0b2c0a14-6548-4e0d-a110-68c034f8dafb req-386eb6b5-a6b7-4ff0-b48a-62bd1afaf9a7 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received event network-changed-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-0b2c0a14-6548-4e0d-a110-68c034f8dafb req-386eb6b5-a6b7-4ff0-b48a-62bd1afaf9a7 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Refreshing instance network info cache due to event network-changed-620ab99e-0aa9-4b39-9963-dc38976df1f4. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:09:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0b2c0a14-6548-4e0d-a110-68c034f8dafb req-386eb6b5-a6b7-4ff0-b48a-62bd1afaf9a7 service nova] Acquiring lock "refresh_cache-2629c515-bd23-4df8-bdfc-4e84c0c06e5a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0b2c0a14-6548-4e0d-a110-68c034f8dafb req-386eb6b5-a6b7-4ff0-b48a-62bd1afaf9a7 service nova] Acquired lock "refresh_cache-2629c515-bd23-4df8-bdfc-4e84c0c06e5a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-0b2c0a14-6548-4e0d-a110-68c034f8dafb req-386eb6b5-a6b7-4ff0-b48a-62bd1afaf9a7 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Refreshing network info cache for port 620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:09:47 user nova-compute[76815]: DEBUG nova.network.neutron [req-0b2c0a14-6548-4e0d-a110-68c034f8dafb req-386eb6b5-a6b7-4ff0-b48a-62bd1afaf9a7 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Updated VIF entry in instance network info cache for port 620ab99e-0aa9-4b39-9963-dc38976df1f4. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:09:47 user nova-compute[76815]: DEBUG nova.network.neutron [req-0b2c0a14-6548-4e0d-a110-68c034f8dafb req-386eb6b5-a6b7-4ff0-b48a-62bd1afaf9a7 service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Updating instance_info_cache with network_info: [{"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0b2c0a14-6548-4e0d-a110-68c034f8dafb req-386eb6b5-a6b7-4ff0-b48a-62bd1afaf9a7 service nova] Releasing lock "refresh_cache-2629c515-bd23-4df8-bdfc-4e84c0c06e5a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad0ff01b-2424-4a96-9157-ff603cb944f3 req-09df5eb4-4dd1-4f2b-81f9-b6eba83ca202 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-changed-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad0ff01b-2424-4a96-9157-ff603cb944f3 req-09df5eb4-4dd1-4f2b-81f9-b6eba83ca202 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Refreshing instance network info cache due to event network-changed-46306924-6ee9-480c-87a9-6a4a86acaa7e. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad0ff01b-2424-4a96-9157-ff603cb944f3 req-09df5eb4-4dd1-4f2b-81f9-b6eba83ca202 service nova] Acquiring lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad0ff01b-2424-4a96-9157-ff603cb944f3 req-09df5eb4-4dd1-4f2b-81f9-b6eba83ca202 service nova] Acquired lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-ad0ff01b-2424-4a96-9157-ff603cb944f3 req-09df5eb4-4dd1-4f2b-81f9-b6eba83ca202 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Refreshing network info cache for port 46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lazy-loading 'flavor' on Instance uuid 2629c515-bd23-4df8-bdfc-4e84c0c06e5a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-ad0ff01b-2424-4a96-9157-ff603cb944f3 req-09df5eb4-4dd1-4f2b-81f9-b6eba83ca202 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updated VIF entry in instance network info cache for port 46306924-6ee9-480c-87a9-6a4a86acaa7e. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-ad0ff01b-2424-4a96-9157-ff603cb944f3 req-09df5eb4-4dd1-4f2b-81f9-b6eba83ca202 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updating instance_info_cache with network_info: [{"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad0ff01b-2424-4a96-9157-ff603cb944f3 req-09df5eb4-4dd1-4f2b-81f9-b6eba83ca202 service nova] Releasing lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:48 user nova-compute[76815]: INFO nova.compute.manager [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Attaching volume 0852ea66-1fb1-44a5-a65e-912e85a02b7a to /dev/sdc
Nov 14 22:09:48 user nova-compute[76815]: DEBUG os_brick.utils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d31b31-ed49-4cfc-bfa1-c71558a87a97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a22238-ed19-4188-b5ff-0f34fd25ba14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b04ab13-4604-472a-9abc-fb6cc1481b55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[047e9820-fc1d-4c2a-b146-f74133e46106]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:09:49 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd86650-325e-4eaf-8f2e-8b25dab631fc]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.utils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Updating existing volume attachment record: 35fdb2df-f29b-4d6d-9445-a71f29cfbc0c {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:49 user nova-compute[76815]: INFO nova.compute.manager [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Rebuilding instance
Nov 14 22:09:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VxHyhwJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:09:49 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:09:49 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:09:49 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b636c-5bcc-4a53-a071-7dc1e93e2ac8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:09:49 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e922c74-f9ae-4a0b-849e-4efdbca3b974]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708] added
Nov 14 22:09:49 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a778c5cb-0dce-4e52-b734-f006691b1dd5]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c662dbc0-65ef-476b-b323-b489bf2b20d5]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VxHyhwJX {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VxHyhwJX" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f515ff9-27bb-4e37-98e4-e0037727e2b8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VxHyhwJX'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24728913-ed79-401e-963d-975eb1195941]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a9159b-43a5-4f04-bcc6-bfca12868314]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c16c0b-fb13-4ec8-8de3-996687afc0b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708, portal: 172.16.0.220,3260]
Nov 14 22:09:50 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708, portal: 172.16.0.220,3260] successful.
Nov 14 22:09:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adf17bc-134a-4fc7-b89b-a9e7e68eb462]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-unplugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] No waiting events found dispatching network-vif-unplugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:09:50 user nova-compute[76815]: WARNING nova.compute.manager [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received unexpected event network-vif-unplugged-46306924-6ee9-480c-87a9-6a4a86acaa7e for instance with vm_state active and task_state rebuilding.
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] No waiting events found dispatching network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:09:50 user nova-compute[76815]: WARNING nova.compute.manager [req-1331d7b0-9b3e-449e-8cfc-30f1d60a5da6 req-c3d9be8f-9f65-49fb-9297-ea54d17c077e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received unexpected event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e for instance with vm_state active and task_state rebuilding.
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f9351-19ae-4149-8cc4-63bc450bdd87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.030s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0494b665-6fe8-4b7d-9429-0abb5af55284]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VxHyhwJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:09:50 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance destroyed successfully.
Nov 14 22:09:50 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance destroyed successfully.
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1997585454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-195882950',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYdEPXMAY/BvZ90CFnDjbrUDJXhggicS+WTg8lo2jdxV4Oxwqif3KxZzm7Zj/wEOoKk76K9c60Oj4htrIR82n8KAEFJjDSxue+s6ZxqtfvL8qnYb+moLbO3gRh8JV6Bug==',key_name='tempest-keypair-958525764',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a73af2afa50e415d85402bbea4bb143a',ramdisk_id='',reservation_id='r-rwperlky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-310072271',owner_user_name='tempest-ServerActionsV293TestJSON-310072271-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:09:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51594092be7f40638e43426bf32e5290',uuid=16c58923-c97e-4148-af31-9609b9af5d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converting VIF {"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_vif [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46306924-6e, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d01936be-e7ef-4e9e-8514-dda17e937c46) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:50 user nova-compute[76815]: INFO os_vif [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e')
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNAXDfGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:09:50 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 22:09:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-3d84bf43-b8ab-4339-8fd0-6bc3cda31000 req-bb25537e-d3ec-4585-86e0-07d420362b7b service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-changed-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-3d84bf43-b8ab-4339-8fd0-6bc3cda31000 req-bb25537e-d3ec-4585-86e0-07d420362b7b service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Refreshing instance network info cache due to event network-changed-5688ed4c-da6e-445f-9839-2d49c9724bc8. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3d84bf43-b8ab-4339-8fd0-6bc3cda31000 req-bb25537e-d3ec-4585-86e0-07d420362b7b service nova] Acquiring lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3d84bf43-b8ab-4339-8fd0-6bc3cda31000 req-bb25537e-d3ec-4585-86e0-07d420362b7b service nova] Acquired lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:50 user nova-compute[76815]: DEBUG nova.network.neutron [req-3d84bf43-b8ab-4339-8fd0-6bc3cda31000 req-bb25537e-d3ec-4585-86e0-07d420362b7b service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Refreshing network info cache for port 5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "interface-91830a3a-8395-4f82-81c3-6aec79a46c33-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "interface-91830a3a-8395-4f82-81c3-6aec79a46c33-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lazy-loading 'flavor' on Instance uuid 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.network.neutron [req-3d84bf43-b8ab-4339-8fd0-6bc3cda31000 req-bb25537e-d3ec-4585-86e0-07d420362b7b service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updated VIF entry in instance network info cache for port 5688ed4c-da6e-445f-9839-2d49c9724bc8. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.network.neutron [req-3d84bf43-b8ab-4339-8fd0-6bc3cda31000 req-bb25537e-d3ec-4585-86e0-07d420362b7b service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updating instance_info_cache with network_info: [{"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3d84bf43-b8ab-4339-8fd0-6bc3cda31000 req-bb25537e-d3ec-4585-86e0-07d420362b7b service nova] Releasing lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26664373437373039', 'path': '/dev/sdi'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664373437373039', 'path': '/dev/sdi'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.671s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lazy-loading 'flavor' on Instance uuid a3ba0d7d-48dd-4718-9447-fb632bd1e57b {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lazy-loading 'pci_requests' on Instance uuid 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.objects.base [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Object Instance<91830a3a-8395-4f82-81c3-6aec79a46c33> lazy-loaded attributes: flavor,pci_requests {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.network.neutron [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96d8bda-a83a-471f-83a5-cca7efef6160]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:09:51 user nova-compute[76815]: No targets found.
Nov 14 22:09:51 user nova-compute[76815]: iSNS:
Nov 14 22:09:51 user nova-compute[76815]: No targets found.
Nov 14 22:09:51 user nova-compute[76815]: STATIC:
Nov 14 22:09:51 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:09:51 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:51 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:51 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:09:51 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:51 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:51 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989
Nov 14 22:09:51 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:51 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:51 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:09:51 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:51 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:51 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708
Nov 14 22:09:51 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:51 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:51 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6
Nov 14 22:09:51 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:51 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:51 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41
Nov 14 22:09:51 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:51 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:51 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b
Nov 14 22:09:51 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:51 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:51 user nova-compute[76815]: FIRMWARE:
Nov 14 22:09:51 user nova-compute[76815]: No targets found.
Nov 14 22:09:51 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:09:51 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:09:51 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c60c7ba-8a4a-4c26-8f1e-194617c85916]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:09:51 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:09:51 user nova-compute[76815]:   <source dev="/dev/sdi"/>
Nov 14 22:09:51 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:09:51 user nova-compute[76815]:   <serial>f124d5f0-d226-4185-9f9e-57756d42f708</serial>
Nov 14 22:09:51 user nova-compute[76815]: </disk>
Nov 14 22:09:51 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c6d1d-3a30-460b-ba40-b35365d24c6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:51 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8395750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.policy [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3356e497cd5243beb1e6d5aa0b24a177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f304c47366c4cd1af23a1f0d43d8825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e69ab1-0712-49e3-82f9-c46590b8bf2a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3cb5f2-a7f3-4736-8d1e-97a3c4b4e109]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6180d8-9b48-4386-8e23-7ca64bdd758d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3621d93c-3c26-4bf6-a007-cd19175b4732]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fad413-add9-4eb4-9cbf-18c56a361309]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd0d824-f53e-4104-83dc-e7170ef5b497]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260]
Nov 14 22:09:51 user nova-compute[76815]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260] successful.
Nov 14 22:09:51 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eee99ac-c66c-4364-8298-8e07caacbbc3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] <== disconnect_volume: return (1046ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:09:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Deleting instance files /opt/stack/data/nova/instances/16c58923-c97e-4148-af31-9609b9af5d80_del
Nov 14 22:09:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Deletion of /opt/stack/data/nova/instances/16c58923-c97e-4148-af31-9609b9af5d80_del complete
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Checking UEFI support for host arch (x86_64) {{(pid=76815) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 22:09:51 user nova-compute[76815]: INFO nova.virt.libvirt.host [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] UEFI support detected
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] No VIF found with MAC fa:16:3e:16:6f:fe, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:09:51 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 16c58923-c97e-4148-af31-9609b9af5d80 could not be found.
Nov 14 22:09:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNAXDfGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:09:51 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:09:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2ce4fc60-abc6-4c9e-9876-d47de4ecc2a6 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.267s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4196c09b-eb4c-4b40-80d3-f175d9aff9b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:09:52 user nova-compute[76815]: No targets found.
Nov 14 22:09:52 user nova-compute[76815]: iSNS:
Nov 14 22:09:52 user nova-compute[76815]: No targets found.
Nov 14 22:09:52 user nova-compute[76815]: STATIC:
Nov 14 22:09:52 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:09:52 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:52 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:52 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:09:52 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:52 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:52 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989
Nov 14 22:09:52 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:52 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:52 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708
Nov 14 22:09:52 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:52 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:52 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6
Nov 14 22:09:52 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:52 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:52 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41
Nov 14 22:09:52 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:52 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:52 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b
Nov 14 22:09:52 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:09:52 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:09:52 user nova-compute[76815]: FIRMWARE:
Nov 14 22:09:52 user nova-compute[76815]: No targets found.
Nov 14 22:09:52 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:09:52 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:09:52 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG nova.network.neutron [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Successfully created port: e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e048be4-85a8-40d2-8e46-f2b10c2e3ab0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40077ba1-00da-4a14-bd94-adbe874396f2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:52 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c862a5f0>, {}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Disconnecting from: [] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] <== disconnect_volume: return (88ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG nova.network.neutron [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Successfully updated port: e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquired lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG nova.network.neutron [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-a2cf5e71-c443-427e-ae53-0685de48e561 req-fb9a3626-317d-42a9-b53d-0a708e714320 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-changed-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-a2cf5e71-c443-427e-ae53-0685de48e561 req-fb9a3626-317d-42a9-b53d-0a708e714320 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Refreshing instance network info cache due to event network-changed-e02f16bb-de13-4564-960f-d0c3991cff42. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:09:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a2cf5e71-c443-427e-ae53-0685de48e561 req-fb9a3626-317d-42a9-b53d-0a708e714320 service nova] Acquiring lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-ed636047-86f5-4b08-b74b-35a7fc89eeea req-569b3ee4-6499-4b7b-90de-a7a8368ab46f service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received event network-changed-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-ed636047-86f5-4b08-b74b-35a7fc89eeea req-569b3ee4-6499-4b7b-90de-a7a8368ab46f service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Refreshing instance network info cache due to event network-changed-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ed636047-86f5-4b08-b74b-35a7fc89eeea req-569b3ee4-6499-4b7b-90de-a7a8368ab46f service nova] Acquiring lock "refresh_cache-ab3b7495-76be-421d-9843-af965b815413" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ed636047-86f5-4b08-b74b-35a7fc89eeea req-569b3ee4-6499-4b7b-90de-a7a8368ab46f service nova] Acquired lock "refresh_cache-ab3b7495-76be-421d-9843-af965b815413" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.network.neutron [req-ed636047-86f5-4b08-b74b-35a7fc89eeea req-569b3ee4-6499-4b7b-90de-a7a8368ab46f service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Refreshing network info cache for port f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Preparing to wait for external event volume-reimaged-0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 {{(pid=76815) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lazy-loading 'flavor' on Instance uuid ab3b7495-76be-421d-9843-af965b815413 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:53 user nova-compute[76815]: INFO nova.compute.manager [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Detaching volume f124d5f0-d226-4185-9f9e-57756d42f708
Nov 14 22:09:53 user nova-compute[76815]: INFO nova.virt.block_device [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Attempting to driver detach volume f124d5f0-d226-4185-9f9e-57756d42f708 from mountpoint /dev/vdb
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Attempting to detach device vdb from instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:09:53 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:09:53 user nova-compute[76815]:   <source dev="/dev/sdi"/>
Nov 14 22:09:53 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:09:53 user nova-compute[76815]:   <serial>f124d5f0-d226-4185-9f9e-57756d42f708</serial>
Nov 14 22:09:53 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:09:53 user nova-compute[76815]: </disk>
Nov 14 22:09:53 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:09:53 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Successfully detached device vdb from instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b from the persistent domain config.
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:09:53 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:09:53 user nova-compute[76815]:   <source dev="/dev/sdi"/>
Nov 14 22:09:53 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:09:53 user nova-compute[76815]:   <serial>f124d5f0-d226-4185-9f9e-57756d42f708</serial>
Nov 14 22:09:53 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:09:53 user nova-compute[76815]: </disk>
Nov 14 22:09:53 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.network.neutron [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updating instance_info_cache with network_info: [{"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.network.neutron [req-ed636047-86f5-4b08-b74b-35a7fc89eeea req-569b3ee4-6499-4b7b-90de-a7a8368ab46f service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Updated VIF entry in instance network info cache for port f1a1d68c-a423-4b04-a0ac-b9b345bb91c0. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.network.neutron [req-ed636047-86f5-4b08-b74b-35a7fc89eeea req-569b3ee4-6499-4b7b-90de-a7a8368ab46f service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Updating instance_info_cache with network_info: [{"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:53 user nova-compute[76815]: INFO nova.compute.manager [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Attaching volume d5daf236-0fb0-4d09-9260-1ac52e92736a to /dev/vdb
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Releasing lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a2cf5e71-c443-427e-ae53-0685de48e561 req-fb9a3626-317d-42a9-b53d-0a708e714320 service nova] Acquired lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.network.neutron [req-a2cf5e71-c443-427e-ae53-0685de48e561 req-fb9a3626-317d-42a9-b53d-0a708e714320 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Refreshing network info cache for port e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239797802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239797802',id=6,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp1I2ExuD5M3u6m5DSKi2h8Sbi9eJkAW82TUikZkZ6/CmyHFgzEt+tH3XphSvsi+i6IpnxEg23xGXTPTV8VZcAvDG1z9g4zldZJtkz5P+3Huuf8Uxsjfoa/XNo/Ex9vg==',key_name='tempest-keypair-1648996082',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f304c47366c4cd1af23a1f0d43d8825',ramdisk_id='',reservation_id='r-m3vhi65s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1610929038',owner_user_name='tempest-TaggedAttachmentsTest-1610929038-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3356e497cd5243beb1e6d5aa0b24a177',uuid=91830a3a-8395-4f82-81c3-6aec79a46c33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converting VIF {"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:98,bridge_name='br-int',has_traffic_filtering=True,id=e02f16bb-de13-4564-960f-d0c3991cff42,network=Network(ab9efc23-9077-40ac-ab20-e2d565885001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02f16bb-de') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG os_vif [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:98,bridge_name='br-int',has_traffic_filtering=True,id=e02f16bb-de13-4564-960f-d0c3991cff42,network=Network(ab9efc23-9077-40ac-ab20-e2d565885001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02f16bb-de') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ed636047-86f5-4b08-b74b-35a7fc89eeea req-569b3ee4-6499-4b7b-90de-a7a8368ab46f service nova] Releasing lock "refresh_cache-ab3b7495-76be-421d-9843-af965b815413" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7a3421d-eba9-50b5-986f-a68e0ea5d698', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape02f16bb-de, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape02f16bb-de, col_values=(('qos', UUID('7474d7fd-e44b-43f4-b93a-34aadfbad946')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape02f16bb-de, col_values=(('external_ids', {'iface-id': 'e02f16bb-de13-4564-960f-d0c3991cff42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:9b:98', 'vm-uuid': '91830a3a-8395-4f82-81c3-6aec79a46c33'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:53 user nova-compute[76815]: INFO os_vif [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:98,bridge_name='br-int',has_traffic_filtering=True,id=e02f16bb-de13-4564-960f-d0c3991cff42,network=Network(ab9efc23-9077-40ac-ab20-e2d565885001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02f16bb-de')
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239797802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239797802',id=6,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp1I2ExuD5M3u6m5DSKi2h8Sbi9eJkAW82TUikZkZ6/CmyHFgzEt+tH3XphSvsi+i6IpnxEg23xGXTPTV8VZcAvDG1z9g4zldZJtkz5P+3Huuf8Uxsjfoa/XNo/Ex9vg==',key_name='tempest-keypair-1648996082',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f304c47366c4cd1af23a1f0d43d8825',ramdisk_id='',reservation_id='r-m3vhi65s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1610929038',owner_user_name='tempest-TaggedAttachmentsTest-1610929038-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3356e497cd5243beb1e6d5aa0b24a177',uuid=91830a3a-8395-4f82-81c3-6aec79a46c33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converting VIF {"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:98,bridge_name='br-int',has_traffic_filtering=True,id=e02f16bb-de13-4564-960f-d0c3991cff42,network=Network(ab9efc23-9077-40ac-ab20-e2d565885001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02f16bb-de') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] attach device xml: <interface type="ethernet">
Nov 14 22:09:53 user nova-compute[76815]:   <mac address="fa:16:3e:47:9b:98"/>
Nov 14 22:09:53 user nova-compute[76815]:   <model type="virtio"/>
Nov 14 22:09:53 user nova-compute[76815]:   <mtu size="1442"/>
Nov 14 22:09:53 user nova-compute[76815]:   <target dev="tape02f16bb-de"/>
Nov 14 22:09:53 user nova-compute[76815]: </interface>
Nov 14 22:09:53 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG os_brick.utils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8437aaa5-3f0c-496a-bcd9-1d2acd3b5f0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd32a7b7-46e0-4941-8844-ecc7261c0091]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59e90eb-5652-4516-b084-fa24de9ab610]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea95ed9-ca89-42a8-b1fb-a1c9eaee52a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:09:53 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9052564c-041c-4523-8096-4a42215858ef]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG os_brick.utils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Updating existing volume attachment record: 070b5ce8-d9fd-4e7a-b99d-3a57a338d11c {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-124e541b-023e-4d1a-818d-a69d29267ef0 req-ec678738-effb-414c-acb2-9979eeac7d72 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-plugged-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-124e541b-023e-4d1a-818d-a69d29267ef0 req-ec678738-effb-414c-acb2-9979eeac7d72 service nova] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-124e541b-023e-4d1a-818d-a69d29267ef0 req-ec678738-effb-414c-acb2-9979eeac7d72 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-124e541b-023e-4d1a-818d-a69d29267ef0 req-ec678738-effb-414c-acb2-9979eeac7d72 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-124e541b-023e-4d1a-818d-a69d29267ef0 req-ec678738-effb-414c-acb2-9979eeac7d72 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] No waiting events found dispatching network-vif-plugged-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:09:53 user nova-compute[76815]: WARNING nova.compute.manager [req-124e541b-023e-4d1a-818d-a69d29267ef0 req-ec678738-effb-414c-acb2-9979eeac7d72 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received unexpected event network-vif-plugged-e02f16bb-de13-4564-960f-d0c3991cff42 for instance with vm_state active and task_state None.
Nov 14 22:09:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG nova.network.neutron [req-a2cf5e71-c443-427e-ae53-0685de48e561 req-fb9a3626-317d-42a9-b53d-0a708e714320 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updated VIF entry in instance network info cache for port e02f16bb-de13-4564-960f-d0c3991cff42. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG nova.network.neutron [req-a2cf5e71-c443-427e-ae53-0685de48e561 req-fb9a3626-317d-42a9-b53d-0a708e714320 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updating instance_info_cache with network_info: [{"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a2cf5e71-c443-427e-ae53-0685de48e561 req-fb9a3626-317d-42a9-b53d-0a708e714320 service nova] Releasing lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtsvAhyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:09:54 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:09:54 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:09:54 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[676e27be-a9eb-46f9-9c3b-234558b89762]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:09:54 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dce862d-c14b-4a9f-98cf-7bb875c9fa7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a] added
Nov 14 22:09:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4801376-8d1b-4db0-a825-f246f94f6bc8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] No BDM found with device name hda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] No VIF found with MAC fa:16:3e:21:d0:50, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be25674a-e3bc-4663-ab7c-7d5b9a3ce31a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtsvAhyL {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jtsvAhyL" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aa081b-7855-4dbb-a956-18d5fde6787d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jtsvAhyL'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:09:54 user nova-compute[76815]:   <nova:package version="0.0.0"/>
Nov 14 22:09:54 user nova-compute[76815]:   <nova:name>tempest-device-tagging-server-239797802</nova:name>
Nov 14 22:09:54 user nova-compute[76815]:   <nova:creationTime>2023-11-14 22:09:54</nova:creationTime>
Nov 14 22:09:54 user nova-compute[76815]:   <nova:flavor name="m1.tiny">
Nov 14 22:09:54 user nova-compute[76815]:     <nova:memory>512</nova:memory>
Nov 14 22:09:54 user nova-compute[76815]:     <nova:disk>1</nova:disk>
Nov 14 22:09:54 user nova-compute[76815]:     <nova:swap>0</nova:swap>
Nov 14 22:09:54 user nova-compute[76815]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:09:54 user nova-compute[76815]:     <nova:vcpus>1</nova:vcpus>
Nov 14 22:09:54 user nova-compute[76815]:   </nova:flavor>
Nov 14 22:09:54 user nova-compute[76815]:   <nova:owner>
Nov 14 22:09:54 user nova-compute[76815]:     <nova:user uuid="3356e497cd5243beb1e6d5aa0b24a177">tempest-TaggedAttachmentsTest-1610929038-project-member</nova:user>
Nov 14 22:09:54 user nova-compute[76815]:     <nova:project uuid="3f304c47366c4cd1af23a1f0d43d8825">tempest-TaggedAttachmentsTest-1610929038</nova:project>
Nov 14 22:09:54 user nova-compute[76815]:   </nova:owner>
Nov 14 22:09:54 user nova-compute[76815]:   <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:09:54 user nova-compute[76815]:   <nova:ports>
Nov 14 22:09:54 user nova-compute[76815]:     <nova:port uuid="5688ed4c-da6e-445f-9839-2d49c9724bc8">
Nov 14 22:09:54 user nova-compute[76815]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:09:54 user nova-compute[76815]:     </nova:port>
Nov 14 22:09:54 user nova-compute[76815]:     <nova:port uuid="e02f16bb-de13-4564-960f-d0c3991cff42">
Nov 14 22:09:54 user nova-compute[76815]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Nov 14 22:09:54 user nova-compute[76815]:     </nova:port>
Nov 14 22:09:54 user nova-compute[76815]:   </nova:ports>
Nov 14 22:09:54 user nova-compute[76815]: </nova:instance>
Nov 14 22:09:54 user nova-compute[76815]:  {{(pid=76815) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8383a5-143d-444c-8d40-ad596b83391b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-27a1be26-57f8-443f-a306-a150ba351c3c tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "interface-91830a3a-8395-4f82-81c3-6aec79a46c33-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.326s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[89429fa1-2d0d-453a-bc6a-83fe7eedf573]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[38314b88-5948-4b7b-8d76-3f08924263fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a, portal: 172.16.0.220,3260]
Nov 14 22:09:54 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a, portal: 172.16.0.220,3260] successful.
Nov 14 22:09:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d7c193-560f-4d4f-baf3-e626f22a0b6b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bc4b32-6349-4c09-aa11-ca5601108169]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1f3441-b21c-4f28-b6a8-f98df7d1dad4]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lazy-loading 'flavor' on Instance uuid 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:54 user nova-compute[76815]: INFO nova.compute.manager [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Attaching volume 19379099-45a5-4b41-aefc-0233ad0222fd to /dev/vdb
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.utils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e6cbc3-3478-4d35-86bb-aa785c21e7b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea61cae-66ba-47d2-a31b-88a82f6c2283]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b16808-4c95-4b7b-8238-3914ea28ba58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b814446f-6802-49c7-9133-a6e69e88bdc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:09:55 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:09:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a2a589-060c-4e24-b422-3925eb602132]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.utils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updating existing volume attachment record: 894f623f-1152-475e-b82f-55c95e121cbb {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtsvAhyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23634613865663038', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634613865663038', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lazy-loading 'flavor' on Instance uuid 2629c515-bd23-4df8-bdfc-4e84c0c06e5a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:09:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:09:55 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:09:55 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:09:55 user nova-compute[76815]:   <target dev="sdc" bus="scsi"/>
Nov 14 22:09:55 user nova-compute[76815]:   <serial>0852ea66-1fb1-44a5-a65e-912e85a02b7a</serial>
Nov 14 22:09:55 user nova-compute[76815]:   <address type="drive" controller="0" unit="2"/>
Nov 14 22:09:55 user nova-compute[76815]: </disk>
Nov 14 22:09:55 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8a2d2d68-4132-4b81-8d65-f1207ae12dd9 req-fbffe6e0-4f4c-4c2a-8333-76e1d7db4520 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-plugged-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8a2d2d68-4132-4b81-8d65-f1207ae12dd9 req-fbffe6e0-4f4c-4c2a-8333-76e1d7db4520 service nova] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8a2d2d68-4132-4b81-8d65-f1207ae12dd9 req-fbffe6e0-4f4c-4c2a-8333-76e1d7db4520 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8a2d2d68-4132-4b81-8d65-f1207ae12dd9 req-fbffe6e0-4f4c-4c2a-8333-76e1d7db4520 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-8a2d2d68-4132-4b81-8d65-f1207ae12dd9 req-fbffe6e0-4f4c-4c2a-8333-76e1d7db4520 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] No waiting events found dispatching network-vif-plugged-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:09:56 user nova-compute[76815]: WARNING nova.compute.manager [req-8a2d2d68-4132-4b81-8d65-f1207ae12dd9 req-fbffe6e0-4f4c-4c2a-8333-76e1d7db4520 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received unexpected event network-vif-plugged-e02f16bb-de13-4564-960f-d0c3991cff42 for instance with vm_state active and task_state None.
Nov 14 22:09:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] No BDM found with device name sda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] No BDM found with device name sdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] No BDM found with device name sdc, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] No VIF found with MAC fa:16:3e:c4:c9:12, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bdfe7ca3-58f4-4f72-8ad6-5dba245c0100 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.575s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:09:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:09:57 user nova-compute[76815]: INFO nova.compute.manager [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Detaching volume 0852ea66-1fb1-44a5-a65e-912e85a02b7a
Nov 14 22:09:57 user nova-compute[76815]: INFO nova.virt.block_device [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Attempting to driver detach volume 0852ea66-1fb1-44a5-a65e-912e85a02b7a from mountpoint /dev/sdc
Nov 14 22:09:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Attempting to detach device sdc from instance 2629c515-bd23-4df8-bdfc-4e84c0c06e5a from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:09:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:09:57 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:09:57 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:09:57 user nova-compute[76815]:   <target dev="sdc" bus="scsi"/>
Nov 14 22:09:57 user nova-compute[76815]:   <serial>0852ea66-1fb1-44a5-a65e-912e85a02b7a</serial>
Nov 14 22:09:57 user nova-compute[76815]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 22:09:57 user nova-compute[76815]: </disk>
Nov 14 22:09:57 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:09:57 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Successfully detached device sdc from instance 2629c515-bd23-4df8-bdfc-4e84c0c06e5a from the persistent domain config.
Nov 14 22:09:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 2629c515-bd23-4df8-bdfc-4e84c0c06e5a from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:09:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:09:57 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:09:57 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:09:57 user nova-compute[76815]:   <target dev="sdc" bus="scsi"/>
Nov 14 22:09:57 user nova-compute[76815]:   <serial>0852ea66-1fb1-44a5-a65e-912e85a02b7a</serial>
Nov 14 22:09:57 user nova-compute[76815]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 22:09:57 user nova-compute[76815]: </disk>
Nov 14 22:09:57 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:09:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 2629c515-bd23-4df8-bdfc-4e84c0c06e5a {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqrJDINa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:09:58 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:09:58 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:09:58 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc0af9e-e550-4457-9d62-d1060882f972]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:09:58 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4539fc4e-965d-477d-8620-ea49e8c4b342]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a] added
Nov 14 22:09:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e70d2b-58b1-4329-a4cf-65ffd0a026c0]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4100f560-73a9-4732-9bd9-557c4b8961fd]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqrJDINa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqrJDINa" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1788b5-91d8-4725-8023-c9df8217d4ac]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BqrJDINa'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[923a9524-a388-4509-8d28-3d82468bb3af]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea03a0d-bca1-40cd-b346-3a1e75199f4f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c29bb8-18fc-47db-a86c-7de12e6a1229]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260]
Nov 14 22:09:59 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260] successful.
Nov 14 22:09:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ebad09-c34f-4eef-b22b-8f00494e0981]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1302620-e129-47b4-9c4d-07d2d1d1c7fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:09:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f29f05f-72fa-4e7d-965e-8b7d5b640411]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:09:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqrJDINa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26566383938383664', 'path': '/dev/sdk'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566383938383664', 'path': '/dev/sdk'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lazy-loading 'flavor' on Instance uuid ab3b7495-76be-421d-9843-af965b815413 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-52a524e2-4c2e-43c1-8471-f61107c82111 req-c462ea4b-1c98-43fb-bd8f-b20782116937 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received event network-changed-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-52a524e2-4c2e-43c1-8471-f61107c82111 req-c462ea4b-1c98-43fb-bd8f-b20782116937 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Refreshing instance network info cache due to event network-changed-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-52a524e2-4c2e-43c1-8471-f61107c82111 req-c462ea4b-1c98-43fb-bd8f-b20782116937 service nova] Acquiring lock "refresh_cache-fd038c28-ee30-4cbe-a0aa-518396ac9fc7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-52a524e2-4c2e-43c1-8471-f61107c82111 req-c462ea4b-1c98-43fb-bd8f-b20782116937 service nova] Acquired lock "refresh_cache-fd038c28-ee30-4cbe-a0aa-518396ac9fc7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.network.neutron [req-52a524e2-4c2e-43c1-8471-f61107c82111 req-c462ea4b-1c98-43fb-bd8f-b20782116937 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Refreshing network info cache for port 2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:10:00 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:00 user nova-compute[76815]:   <source dev="/dev/sdk"/>
Nov 14 22:10:00 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:10:00 user nova-compute[76815]:   <serial>d5daf236-0fb0-4d09-9260-1ac52e92736a</serial>
Nov 14 22:10:00 user nova-compute[76815]: </disk>
Nov 14 22:10:00 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfhtJVRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:00 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:00 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:00 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d13028-c648-4774-a509-85af34c99874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:10:00 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[30858158-d16b-450a-8bd2-24d28e6c9a73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd] added
Nov 14 22:10:00 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[636e5bd6-2b1e-416a-835d-6e7e52d725a4]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea6dc0d-c6e5-4a84-a848-092f9522c40c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfhtJVRp {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfhtJVRp" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eb2afd-88f2-4cfe-a11e-e644f89f07d5]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WfhtJVRp'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff654a4-506c-49a1-9db9-04bc3691f97e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fee11c-0289-4b29-bafb-1e39a9467856]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.objects.instance [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lazy-loading 'flavor' on Instance uuid fd038c28-ee30-4cbe-a0aa-518396ac9fc7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79dcf2-a4e2-4219-94a7-108b8601512d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd, portal: 172.16.0.220,3260]
Nov 14 22:10:00 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:00 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ea3e9e-0df9-473d-befd-ed5b0a6d9ba8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] No VIF found with MAC fa:16:3e:ee:90:44, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[887cf349-5146-4231-8de5-f2b9917e9116]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:00 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72052f98-476f-4d10-97f2-46dbb5e929d2]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfhtJVRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:00 user nova-compute[76815]: INFO nova.compute.manager [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Attaching volume 66727a2e-8873-464e-8e2e-1b465c19e84d to /dev/vdb
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.network.neutron [req-52a524e2-4c2e-43c1-8471-f61107c82111 req-c462ea4b-1c98-43fb-bd8f-b20782116937 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Updated VIF entry in instance network info cache for port 2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.network.neutron [req-52a524e2-4c2e-43c1-8471-f61107c82111 req-c462ea4b-1c98-43fb-bd8f-b20782116937 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Updating instance_info_cache with network_info: [{"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-52a524e2-4c2e-43c1-8471-f61107c82111 req-c462ea4b-1c98-43fb-bd8f-b20782116937 service nova] Releasing lock "refresh_cache-fd038c28-ee30-4cbe-a0aa-518396ac9fc7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.utils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0c3dd5b3-13c7-4168-820a-877496817214 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.286s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6332c7da-7272-47c9-a1de-94e73894f773]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc5476-019a-4475-9b6a-b5df466d953e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9db949-8eba-4182-80da-683823cc57f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c072b4-4b6c-4711-bb92-da29088597dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:10:00 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:10:00 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c161fb2-0e96-4710-8f51-cc07689685b1]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG os_brick.utils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:00 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Updating existing volume attachment record: 87b5b2ed-a575-4198-9af6-455c9860f6fa {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "ab3b7495-76be-421d-9843-af965b815413" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG os_brick.utils [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7665f570-7510-45e3-b156-297fbc7af68b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada1ee8b-43a1-4691-bf6c-9c7b75891969]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6198a7dd-002a-454e-a2a0-c52d7428c5e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd0dde5-21b0-4ce4-9652-aca81a6f878e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:10:01 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:10:01 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72779581-d35f-4eca-a7e2-1f972d15f7e6]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG os_brick.utils [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '26336633962316661', 'path': '/dev/sdl'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336633962316661', 'path': '/dev/sdl'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lazy-loading 'flavor' on Instance uuid 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:10:01 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:01 user nova-compute[76815]:   <source dev="/dev/sdl"/>
Nov 14 22:10:01 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:10:01 user nova-compute[76815]:   <serial>19379099-45a5-4b41-aefc-0233ad0222fd</serial>
Nov 14 22:10:01 user nova-compute[76815]: </disk>
Nov 14 22:10:01 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:10:01 user nova-compute[76815]: INFO nova.compute.manager [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] Swapping volume d5daf236-0fb0-4d09-9260-1ac52e92736a for 77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:10:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] No BDM found with device name hda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:10:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] No VIF found with MAC fa:16:3e:21:d0:50, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:10:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0592be8f-0d89-4ca0-b2cd-049771cf0e03 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.338s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:03 user nova-compute[76815]: INFO nova.compute.manager [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Detaching volume 19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:03 user nova-compute[76815]: INFO nova.virt.block_device [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Attempting to driver detach volume 19379099-45a5-4b41-aefc-0233ad0222fd from mountpoint /dev/vdb
Nov 14 22:10:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Attempting to detach device vdb from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:10:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:10:03 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:03 user nova-compute[76815]:   <source dev="/dev/sdl"/>
Nov 14 22:10:03 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:10:03 user nova-compute[76815]:   <serial>19379099-45a5-4b41-aefc-0233ad0222fd</serial>
Nov 14 22:10:03 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 22:10:03 user nova-compute[76815]: </disk>
Nov 14 22:10:03 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:10:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Successfully detached device vdb from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 from the persistent domain config.
Nov 14 22:10:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:10:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:10:03 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:03 user nova-compute[76815]:   <source dev="/dev/sdl"/>
Nov 14 22:10:03 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:10:03 user nova-compute[76815]:   <serial>19379099-45a5-4b41-aefc-0233ad0222fd</serial>
Nov 14 22:10:03 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 22:10:03 user nova-compute[76815]: </disk>
Nov 14 22:10:03 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:10:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:10:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:06 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgmAjBPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab3b7495-76be-421d-9843-af965b815413', 'attached_at': '', 'detached_at': '', 'volume_id': '77f0352b-63c8-4346-8d3c-d25826044d8b', 'serial': '77f0352b-63c8-4346-8d3c-d25826044d8b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqrJDINa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'ab3b7495-76be-421d-9843-af965b815413', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5daf236-0fb0-4d09-9260-1ac52e92736a', 'serial'} {{(pid=76815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgmAjBPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:07 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:07 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:07 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d394a496-f639-4fbc-87a7-8c3e8cf27c71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:10:07 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6392e8-5e3d-4708-99cb-3b966d62b5b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b] added
Nov 14 22:10:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59fc6b9-e811-4850-b1e8-4ac74c3c8ea9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9535bb74-aa75-4c23-9cf9-42b960ecae1c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GgmAjBPz {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GgmAjBPz" returned: 0 in 0.062s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7244dda-e253-47fb-80b1-6751dcd6e1f1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GgmAjBPz'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d311fa7-3d6e-482b-8d82-74175382fe78]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[966b9014-9dc9-4dde-8b74-94059ca3e460]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a099766-ae8b-4b54-b473-6c0e43fa3742]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b, portal: 172.16.0.220,3260]
Nov 14 22:10:07 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3d571e-1cf1-4898-ab72-1a5cae5643eb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc6d082-dd83-428f-8992-6d425eb60e59]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab1f885-4548-4dfe-a538-b2fa1c0922df]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgmAjBPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZwbucjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:07 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-cf947752-64ff-4f79-895a-382634f0c5b6 req-b51787f5-4494-4e6a-910f-08717741657a service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event volume-reimaged-0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cf947752-64ff-4f79-895a-382634f0c5b6 req-b51787f5-4494-4e6a-910f-08717741657a service nova] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cf947752-64ff-4f79-895a-382634f0c5b6 req-b51787f5-4494-4e6a-910f-08717741657a service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cf947752-64ff-4f79-895a-382634f0c5b6 req-b51787f5-4494-4e6a-910f-08717741657a service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-cf947752-64ff-4f79-895a-382634f0c5b6 req-b51787f5-4494-4e6a-910f-08717741657a service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Processing event volume-reimaged-0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:10:07 user nova-compute[76815]: INFO nova.virt.block_device [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Booting with volume 0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 at /dev/vda
Nov 14 22:10:07 user nova-compute[76815]: DEBUG os_brick.utils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8397752-4157-49ac-bf87-f70312de0c29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a296d9c5-1976-438e-b4bd-5929780f107e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f33dfc-be4b-4430-bc96-509d61324b97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec9b505-d929-44fb-ac0d-91fe909b6665]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:10:08 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d02cd02-f247-4699-a7d4-fda8c3b66109]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.utils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updating existing volume attachment record: 3a660e35-74db-4070-b687-b41907f9cff7 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '26264353331653061', 'path': '/dev/sdj'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264353331653061', 'path': '/dev/sdj'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.777s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:08 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:08 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG nova.objects.instance [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lazy-loading 'flavor' on Instance uuid ab3b7495-76be-421d-9843-af965b815413 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b6805b-3cfa-49e0-b849-cbd26bbd1f8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:10:08 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b7c562-695f-4a4c-b460-90eabe9b0a4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d] added
Nov 14 22:10:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39327bb-7e11-4128-8f23-239642d5c686]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b0a24b-1c31-43db-82cc-c837a1595e29]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZwbucjQ {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZwbucjQ" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e59dfdc-d6ae-4aca-90b3-8b2fcceed222]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SZwbucjQ'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc5c430-1f75-4916-a6f5-82b7aadb2715]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.103s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a94112-2cc7-4d15-a6c7-efa4388f86d8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ab2483-2aca-4cd6-8fb2-56413c9ce190]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d, portal: 172.16.0.220,3260]
Nov 14 22:10:08 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf546eb0-4ced-42af-8733-cd74b10c87ef]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebebf9cd-1454-4ab1-bd02-9f740f8733fd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] HCTL ('44', '-', '-', 0) found on session 15 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[340db91d-4ba5-48c8-b0b4-9d55959c2b5f]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:09 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:10:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 155189248 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-fcaa7a16-098a-46fe-b527-3bab771bb953 req-e15bc35f-5692-40df-a52f-397bc7235293 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-changed-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-fcaa7a16-098a-46fe-b527-3bab771bb953 req-e15bc35f-5692-40df-a52f-397bc7235293 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing instance network info cache due to event network-changed-181fec50-aed8-46cf-8926-666ba8b4ccad. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:10:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fcaa7a16-098a-46fe-b527-3bab771bb953 req-e15bc35f-5692-40df-a52f-397bc7235293 service nova] Acquiring lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:10:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fcaa7a16-098a-46fe-b527-3bab771bb953 req-e15bc35f-5692-40df-a52f-397bc7235293 service nova] Acquired lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:10:09 user nova-compute[76815]: DEBUG nova.network.neutron [req-fcaa7a16-098a-46fe-b527-3bab771bb953 req-e15bc35f-5692-40df-a52f-397bc7235293 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Refreshing network info cache for port 181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 313524224 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZwbucjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] <== connect_volume: return (2262ms) {'type': 'block', 'scsi_wwn': '26134333135363434', 'path': '/dev/sdm'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134333135363434', 'path': '/dev/sdm'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.objects.instance [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lazy-loading 'flavor' on Instance uuid fd038c28-ee30-4cbe-a0aa-518396ac9fc7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 22:10:10 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:10 user nova-compute[76815]:   <source dev="/dev/sdm"/>
Nov 14 22:10:10 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:10:10 user nova-compute[76815]:   <serial>66727a2e-8873-464e-8e2e-1b465c19e84d</serial>
Nov 14 22:10:10 user nova-compute[76815]: </disk>
Nov 14 22:10:10 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.network.neutron [req-fcaa7a16-098a-46fe-b527-3bab771bb953 req-e15bc35f-5692-40df-a52f-397bc7235293 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updated VIF entry in instance network info cache for port 181fec50-aed8-46cf-8926-666ba8b4ccad. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.network.neutron [req-fcaa7a16-098a-46fe-b527-3bab771bb953 req-e15bc35f-5692-40df-a52f-397bc7235293 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [{"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fcaa7a16-098a-46fe-b527-3bab771bb953 req-e15bc35f-5692-40df-a52f-397bc7235293 service nova] Releasing lock "refresh_cache-38304882-101f-43c4-8c18-028c609924d3" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 446693376 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] No VIF found with MAC fa:16:3e:fb:2d:b5, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:10:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-900258c8-de69-45c9-aec7-2805c2e8a6f1 tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.092s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 606076928 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-2078ea7a-6ef4-41dc-91cf-f972d874e71b req-078f2433-509d-4683-a400-80140294b9d5 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-changed-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-2078ea7a-6ef4-41dc-91cf-f972d874e71b req-078f2433-509d-4683-a400-80140294b9d5 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing instance network info cache due to event network-changed-891499b5-a743-47f5-be77-20fd703dba98. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2078ea7a-6ef4-41dc-91cf-f972d874e71b req-078f2433-509d-4683-a400-80140294b9d5 service nova] Acquiring lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2078ea7a-6ef4-41dc-91cf-f972d874e71b req-078f2433-509d-4683-a400-80140294b9d5 service nova] Acquired lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG nova.network.neutron [req-2078ea7a-6ef4-41dc-91cf-f972d874e71b req-078f2433-509d-4683-a400-80140294b9d5 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Refreshing network info cache for port 891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 759169024 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cfb6eeac-af80-4c9f-b606-e00d630b4dda tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] volume_snapshot_create: create_info: {'snapshot_id': '94ad3d70-69c8-485c-b62f-2a18ed8adfb6', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=76815) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cfb6eeac-af80-4c9f-b606-e00d630b4dda tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] snap xml: <domainsnapshot>
Nov 14 22:10:11 user nova-compute[76815]:   <disks>
Nov 14 22:10:11 user nova-compute[76815]:     <disk name="/dev/sdm" snapshot="external" type="file">
Nov 14 22:10:11 user nova-compute[76815]:       <source file="/dev/new_file"/>
Nov 14 22:10:11 user nova-compute[76815]:     </disk>
Nov 14 22:10:11 user nova-compute[76815]:     <disk name="vda" snapshot="no"/>
Nov 14 22:10:11 user nova-compute[76815]:   </disks>
Nov 14 22:10:11 user nova-compute[76815]: </domainsnapshot>
Nov 14 22:10:11 user nova-compute[76815]:  {{(pid=76815) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 22:10:11 user nova-compute[76815]: DEBUG nova.objects.instance [None req-cfb6eeac-af80-4c9f-b606-e00d630b4dda tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] Lazy-loading 'system_metadata' on Instance uuid fd038c28-ee30-4cbe-a0aa-518396ac9fc7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-cfb6eeac-af80-4c9f-b606-e00d630b4dda tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [None req-cfb6eeac-af80-4c9f-b606-e00d630b4dda tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Traceback (most recent call last):
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     rv = execute(f, *args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     six.reraise(c, e, tb)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     raise value
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     rv = meth(*args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] 
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [None req-cfb6eeac-af80-4c9f-b606-e00d630b4dda tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Traceback (most recent call last):
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     self._volume_snapshot_create(context, instance, guest,
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     rv = execute(f, *args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     six.reraise(c, e, tb)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     raise value
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     rv = meth(*args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] 
Nov 14 22:10:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-efc50075-e77c-4810-be88-5fafbf96c5c9 tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] volume_snapshot_delete: delete_info: {'volume_id': '66727a2e-8873-464e-8e2e-1b465c19e84d'} {{(pid=76815) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [None req-efc50075-e77c-4810-be88-5fafbf96c5c9 tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Traceback (most recent call last):
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7]     if delete_info['type'] != 'qcow2':
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] KeyError: 'type'
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] 
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [None req-cfb6eeac-af80-4c9f-b606-e00d630b4dda tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 94ad3d70-69c8-485c-b62f-2a18ed8adfb6 could not be found.
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 94ad3d70-69c8-485c-b62f-2a18ed8adfb6 could not be found. (HTTP 404) (Request-ID: req-ce1bae7b-939f-4ef5-9d5b-a60035bab87d)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 94ad3d70-69c8-485c-b62f-2a18ed8adfb6 could not be found.
Nov 14 22:10:11 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server [None req-cfb6eeac-af80-4c9f-b606-e00d630b4dda tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server 
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver [None req-efc50075-e77c-4810-be88-5fafbf96c5c9 tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-b64d32cc-a384-4270-8331-75dd211f9bb6)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 22:10:12 user nova-compute[76815]: ERROR nova.virt.libvirt.driver 
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server [None req-efc50075-e77c-4810-be88-5fafbf96c5c9 tempest-VolumesAssistedSnapshotsTest-350154063 tempest-VolumesAssistedSnapshotsTest-350154063-project] Exception during message handling: KeyError: 'type'
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 22:10:12 user nova-compute[76815]: ERROR oslo_messaging.rpc.server 
Nov 14 22:10:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 868220928 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:12 user nova-compute[76815]: INFO nova.compute.manager [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Detaching volume 66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:12 user nova-compute[76815]: INFO nova.virt.block_device [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Attempting to driver detach volume 66727a2e-8873-464e-8e2e-1b465c19e84d from mountpoint /dev/vdb
Nov 14 22:10:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Attempting to detach device vdb from instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:10:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 22:10:12 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:12 user nova-compute[76815]:   <source dev="/dev/sdm"/>
Nov 14 22:10:12 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:10:12 user nova-compute[76815]:   <serial>66727a2e-8873-464e-8e2e-1b465c19e84d</serial>
Nov 14 22:10:12 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:10:12 user nova-compute[76815]: </disk>
Nov 14 22:10:12 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:10:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Successfully detached device vdb from instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 from the persistent domain config.
Nov 14 22:10:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:10:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 22:10:12 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:12 user nova-compute[76815]:   <source dev="/dev/sdm"/>
Nov 14 22:10:12 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:10:12 user nova-compute[76815]:   <serial>66727a2e-8873-464e-8e2e-1b465c19e84d</serial>
Nov 14 22:10:12 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:10:12 user nova-compute[76815]: </disk>
Nov 14 22:10:12 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:10:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 1010827264 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:12 user nova-compute[76815]: DEBUG nova.network.neutron [req-2078ea7a-6ef4-41dc-91cf-f972d874e71b req-078f2433-509d-4683-a400-80140294b9d5 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updated VIF entry in instance network info cache for port 891499b5-a743-47f5-be77-20fd703dba98. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:10:12 user nova-compute[76815]: DEBUG nova.network.neutron [req-2078ea7a-6ef4-41dc-91cf-f972d874e71b req-078f2433-509d-4683-a400-80140294b9d5 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [{"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2078ea7a-6ef4-41dc-91cf-f972d874e71b req-078f2433-509d-4683-a400-80140294b9d5 service nova] Releasing lock "refresh_cache-13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:10:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqrJDINa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:13 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[879d7072-3164-4ff1-9d2f-573911b79a90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:13 user nova-compute[76815]: No targets found.
Nov 14 22:10:13 user nova-compute[76815]: iSNS:
Nov 14 22:10:13 user nova-compute[76815]: No targets found.
Nov 14 22:10:13 user nova-compute[76815]: STATIC:
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b
Nov 14 22:10:13 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:13 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:13 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:13 user nova-compute[76815]: No targets found.
Nov 14 22:10:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:13 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:13 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f885ec5f-cd6d-4824-a5db-f5c8680c559c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f548b2a0-eec1-44a1-bacd-b6d24cf87463]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4505630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a'): ({'sdk'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Removing single pathed devices sdk {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[940a7034-f331-4af6-9ada-9ed263a09a4c]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[358bcfa7-cdeb-4a15-8dfa-97085c89429f]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Flushing IO for device /dev/sdk {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2932eca-32aa-4535-bd04-b43cf8a0f0ff]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.040s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a0efed-5c8d-46a0-b71c-10f9d4dbad4c]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] SCSI volumes sdk have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ed2ebb-a297-424f-b71a-bf81604095f4]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "38304882-101f-43c4-8c18-028c609924d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:13 user nova-compute[76815]: INFO nova.compute.manager [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Terminating instance
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7f0a57-8e1b-4acc-97e1-c2b9b0c3a0e2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260]
Nov 14 22:10:13 user nova-compute[76815]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6389f91-1dbc-4f2c-bc69-05e71c0e3f50]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] <== disconnect_volume: return (387ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgmAjBPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'ab3b7495-76be-421d-9843-af965b815413', 'attached_at': '', 'detached_at': '', 'volume_id': '77f0352b-63c8-4346-8d3c-d25826044d8b', 'serial'} {{(pid=76815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] swap_volume: removing Cinder connection for volume d5daf236-0fb0-4d09-9260-1ac52e92736a {{(pid=76815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-d217548d-c3f1-434e-b5ab-2e0b7f2571fa req-230f167d-2455-4d48-9380-d52b3f136117 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d217548d-c3f1-434e-b5ab-2e0b7f2571fa req-230f167d-2455-4d48-9380-d52b3f136117 service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d217548d-c3f1-434e-b5ab-2e0b7f2571fa req-230f167d-2455-4d48-9380-d52b3f136117 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d217548d-c3f1-434e-b5ab-2e0b7f2571fa req-230f167d-2455-4d48-9380-d52b3f136117 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-d217548d-c3f1-434e-b5ab-2e0b7f2571fa req-230f167d-2455-4d48-9380-d52b3f136117 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-unplugged-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-d217548d-c3f1-434e-b5ab-2e0b7f2571fa req-230f167d-2455-4d48-9380-d52b3f136117 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-181fec50-aed8-46cf-8926-666ba8b4ccad for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:10:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Creating image(s)
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Ensure instance console log exists: /opt/stack/data/nova/instances/16c58923-c97e-4148-af31-9609b9af5d80/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Start _get_guest_xml network_info=[{"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNAXDfGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16c58923-c97e-4148-af31-9609b9af5d80', 'attached_at': '', 'detached_at': '', 'volume_id': '0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'serial': '0ddc9d17-eda6-4c6d-96e2-2179bc7fd343'}, 'attachment_id': '3a660e35-74db-4070-b687-b41907f9cff7', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:10:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 22:10:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.objects.instance [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16c58923-c97e-4148-af31-9609b9af5d80 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNAXDfGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:13 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:13 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:13 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:10:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b is timed out.
Nov 14 22:10:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Successfully detached device vdb from instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b from the live domain config.
Nov 14 22:10:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VxHyhwJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:14 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e508acac-1ad6-4422-8801-dc2148476117]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:10:14 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b402a57e-43a6-4318-81e8-78afbba5aa4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343] added
Nov 14 22:10:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6f246e-689c-4747-adcf-edd6089380b3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75c81a1-7f04-4887-8094-806fa3800bdf]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNAXDfGd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HNAXDfGd" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea77287d-66e7-490b-915e-00835a904e6f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HNAXDfGd'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3179f6d-1713-49f2-a5ca-330ef6b4d5b6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd287fe-d655-478f-9c80-f3f588a350a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-99a79cb6-b203-4749-9dae-290dbe05d49c req-b7eefc87-a480-402b-badb-b43bd37a1dbf service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-99a79cb6-b203-4749-9dae-290dbe05d49c req-b7eefc87-a480-402b-badb-b43bd37a1dbf service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-99a79cb6-b203-4749-9dae-290dbe05d49c req-b7eefc87-a480-402b-badb-b43bd37a1dbf service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-99a79cb6-b203-4749-9dae-290dbe05d49c req-b7eefc87-a480-402b-badb-b43bd37a1dbf service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-99a79cb6-b203-4749-9dae-290dbe05d49c req-b7eefc87-a480-402b-badb-b43bd37a1dbf service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-unplugged-00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-99a79cb6-b203-4749-9dae-290dbe05d49c req-b7eefc87-a480-402b-badb-b43bd37a1dbf service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-00031166-05b9-413e-814b-3d9ca500dce6 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-18ce83e9-648f-4dde-9454-47b26368e927 req-0d84a0ea-5fe5-4249-bc73-ca09df7a9c65 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18ce83e9-648f-4dde-9454-47b26368e927 req-0d84a0ea-5fe5-4249-bc73-ca09df7a9c65 service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18ce83e9-648f-4dde-9454-47b26368e927 req-0d84a0ea-5fe5-4249-bc73-ca09df7a9c65 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18ce83e9-648f-4dde-9454-47b26368e927 req-0d84a0ea-5fe5-4249-bc73-ca09df7a9c65 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-18ce83e9-648f-4dde-9454-47b26368e927 req-0d84a0ea-5fe5-4249-bc73-ca09df7a9c65 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-unplugged-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-18ce83e9-648f-4dde-9454-47b26368e927 req-0d84a0ea-5fe5-4249-bc73-ca09df7a9c65 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-a2da1829-8bd3-4b37-85b1-2df590321e79 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --login" returned: 0 in 0.142s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64e8d7-b7e2-49ad-b19d-61fcb0c1df33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260]
Nov 14 22:10:14 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:14 user nova-compute[76815]: INFO nova.compute.manager [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Terminating instance
Nov 14 22:10:14 user nova-compute[76815]: DEBUG nova.compute.manager [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f7d68e-f18e-4b05-a848-d23878e4f294]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c598d89e-06ae-4ac8-88cf-752177224fcf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.475s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] HCTL ('42', '-', '-', 0) found on session 16 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fd501f-91b1-4735-9fd2-6f0b37b8f073]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNAXDfGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] swap_volume: Updating volume d5daf236-0fb0-4d09-9260-1ac52e92736a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "GgmAjBPz", "auth_password": "S8c7RCGZxm3weW", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "77f0352b-63c8-4346-8d3c-d25826044d8b"}, "status": "reserved", "instance": "ab3b7495-76be-421d-9843-af965b815413", "attached_at": "", "detached_at": "", "volume_id": "77f0352b-63c8-4346-8d3c-d25826044d8b", "serial": "77f0352b-63c8-4346-8d3c-d25826044d8b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '77f0352b-63c8-4346-8d3c-d25826044d8b', 'no_device': None, 'attachment_id': 'ef1a72ad-52e0-4570-896f-32f59fc0484f'} {{(pid=76815) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cb4dfc21-f7e0-4eb6-beea-5b41ffc5a8ef tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "ab3b7495-76be-421d-9843-af965b815413" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.193s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 38304882-101f-43c4-8c18-028c609924d3] Instance destroyed successfully.
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lazy-loading 'resources' on Instance uuid 38304882-101f-43c4-8c18-028c609924d3 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "181fec50-aed8-46cf-8926-666ba8b4ccad", "address": "fa:16:3e:53:58:86", "network": {"id": "4564429a-fbb9-49ed-a69f-4bb06e543c65", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2012301016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181fec50-ae", "ovs_interfaceid": "181fec50-aed8-46cf-8926-666ba8b4ccad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:58:86,bridge_name='br-int',has_traffic_filtering=True,id=181fec50-aed8-46cf-8926-666ba8b4ccad,network=Network(4564429a-fbb9-49ed-a69f-4bb06e543c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181fec50-ae') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:58:86,bridge_name='br-int',has_traffic_filtering=True,id=181fec50-aed8-46cf-8926-666ba8b4ccad,network=Network(4564429a-fbb9-49ed-a69f-4bb06e543c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181fec50-ae') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap181fec50-ae, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.532s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] <== connect_volume: return (1534ms) {'type': 'block', 'scsi_wwn': '26237383437613733', 'path': '/dev/sdk'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237383437613733', 'path': '/dev/sdk'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.508s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bd5043-2a4d-44f5-8e5f-4e00c9769e25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:15 user nova-compute[76815]: No targets found.
Nov 14 22:10:15 user nova-compute[76815]: iSNS:
Nov 14 22:10:15 user nova-compute[76815]: No targets found.
Nov 14 22:10:15 user nova-compute[76815]: STATIC:
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b
Nov 14 22:10:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:15 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:15 user nova-compute[76815]: No targets found.
Nov 14 22:10:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:15 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:15 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1997585454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-195882950',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYdEPXMAY/BvZ90CFnDjbrUDJXhggicS+WTg8lo2jdxV4Oxwqif3KxZzm7Zj/wEOoKk76K9c60Oj4htrIR82n8KAEFJjDSxue+s6ZxqtfvL8qnYb+moLbO3gRh8JV6Bug==',key_name='tempest-keypair-958525764',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a73af2afa50e415d85402bbea4bb143a',ramdisk_id='',reservation_id='r-rwperlky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-310072271',owner_user_name='tempest-ServerActionsV293TestJSON-310072271-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:10:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51594092be7f40638e43426bf32e5290',uuid=16c58923-c97e-4148-af31-9609b9af5d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converting VIF {"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:10:15 user nova-compute[76815]:   <uuid>16c58923-c97e-4148-af31-9609b9af5d80</uuid>
Nov 14 22:10:15 user nova-compute[76815]:   <name>instance-00000005</name>
Nov 14 22:10:15 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:10:15 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:10:15 user nova-compute[76815]:   <metadata>
Nov 14 22:10:15 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:10:15 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:10:15 user nova-compute[76815]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1997585454</nova:name>
Nov 14 22:10:15 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:10:13</nova:creationTime>
Nov 14 22:10:15 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:10:15 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:10:15 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:10:15 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:10:15 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:10:15 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:10:15 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:10:15 user nova-compute[76815]:       <nova:owner>
Nov 14 22:10:15 user nova-compute[76815]:         <nova:user uuid="51594092be7f40638e43426bf32e5290">tempest-ServerActionsV293TestJSON-310072271-project-member</nova:user>
Nov 14 22:10:15 user nova-compute[76815]:         <nova:project uuid="a73af2afa50e415d85402bbea4bb143a">tempest-ServerActionsV293TestJSON-310072271</nova:project>
Nov 14 22:10:15 user nova-compute[76815]:       </nova:owner>
Nov 14 22:10:15 user nova-compute[76815]:       <nova:ports>
Nov 14 22:10:15 user nova-compute[76815]:         <nova:port uuid="46306924-6ee9-480c-87a9-6a4a86acaa7e">
Nov 14 22:10:15 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 22:10:15 user nova-compute[76815]:         </nova:port>
Nov 14 22:10:15 user nova-compute[76815]:       </nova:ports>
Nov 14 22:10:15 user nova-compute[76815]:     </nova:instance>
Nov 14 22:10:15 user nova-compute[76815]:   </metadata>
Nov 14 22:10:15 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:10:15 user nova-compute[76815]:     <system>
Nov 14 22:10:15 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:10:15 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:10:15 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:10:15 user nova-compute[76815]:       <entry name="serial">16c58923-c97e-4148-af31-9609b9af5d80</entry>
Nov 14 22:10:15 user nova-compute[76815]:       <entry name="uuid">16c58923-c97e-4148-af31-9609b9af5d80</entry>
Nov 14 22:10:15 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:10:15 user nova-compute[76815]:     </system>
Nov 14 22:10:15 user nova-compute[76815]:   </sysinfo>
Nov 14 22:10:15 user nova-compute[76815]:   <os>
Nov 14 22:10:15 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:10:15 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:10:15 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:10:15 user nova-compute[76815]:   </os>
Nov 14 22:10:15 user nova-compute[76815]:   <features>
Nov 14 22:10:15 user nova-compute[76815]:     <acpi/>
Nov 14 22:10:15 user nova-compute[76815]:     <apic/>
Nov 14 22:10:15 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:10:15 user nova-compute[76815]:   </features>
Nov 14 22:10:15 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:10:15 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:10:15 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:10:15 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:10:15 user nova-compute[76815]:   </clock>
Nov 14 22:10:15 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:10:15 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:10:15 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:10:15 user nova-compute[76815]:   </cpu>
Nov 14 22:10:15 user nova-compute[76815]:   <devices>
Nov 14 22:10:15 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:10:15 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:15 user nova-compute[76815]:       <source dev="/dev/sdk"/>
Nov 14 22:10:15 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:10:15 user nova-compute[76815]:       <serial>0ddc9d17-eda6-4c6d-96e2-2179bc7fd343</serial>
Nov 14 22:10:15 user nova-compute[76815]:     </disk>
Nov 14 22:10:15 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:10:15 user nova-compute[76815]:       <mac address="fa:16:3e:3f:b3:fb"/>
Nov 14 22:10:15 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:10:15 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:10:15 user nova-compute[76815]:       <target dev="tap46306924-6e"/>
Nov 14 22:10:15 user nova-compute[76815]:     </interface>
Nov 14 22:10:15 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:10:15 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/16c58923-c97e-4148-af31-9609b9af5d80/console.log" append="off"/>
Nov 14 22:10:15 user nova-compute[76815]:     </serial>
Nov 14 22:10:15 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:10:15 user nova-compute[76815]:     <video>
Nov 14 22:10:15 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:10:15 user nova-compute[76815]:     </video>
Nov 14 22:10:15 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:10:15 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:10:15 user nova-compute[76815]:     </rng>
Nov 14 22:10:15 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:10:15 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:10:15 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:10:15 user nova-compute[76815]:     </memballoon>
Nov 14 22:10:15 user nova-compute[76815]:   </devices>
Nov 14 22:10:15 user nova-compute[76815]: </domain>
Nov 14 22:10:15 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1997585454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-195882950',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYdEPXMAY/BvZ90CFnDjbrUDJXhggicS+WTg8lo2jdxV4Oxwqif3KxZzm7Zj/wEOoKk76K9c60Oj4htrIR82n8KAEFJjDSxue+s6ZxqtfvL8qnYb+moLbO3gRh8JV6Bug==',key_name='tempest-keypair-958525764',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a73af2afa50e415d85402bbea4bb143a',ramdisk_id='',reservation_id='r-rwperlky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-310072271',owner_user_name='tempest-ServerActionsV293TestJSON-310072271-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:10:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51594092be7f40638e43426bf32e5290',uuid=16c58923-c97e-4148-af31-9609b9af5d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converting VIF {"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_vif [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcbe329-018f-4090-b891-b33ac47b34a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1232f68-eb60-45fc-9ab7-216d0e1df1fb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 (non-flash)
Nov 14 22:10:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c862a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708'): ({'sdi'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Removing single pathed devices sdi {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d53d9a-449f-44b9-a811-2436ea53c593]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8364586d-2870-4102-a91b-11f6a10a3be0) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b6238d-4b67-436a-a8fd-0dfe6c1963e3]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Flushing IO for device /dev/sdi {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b9400-7e27-4252-9f58-8f1b798d0d0a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[988e1a6c-89e8-459e-bcef-5c42a9821f41]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] SCSI volumes sdi have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26664373437373039', '/dev/disk/by-id/scsi-1SCST_BIOdb3b3d3e-fd747709d5935c1c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_db3b3d3e') {{(pid=86648) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[161bd8e8-3858-46c7-af7c-d01d3dfbe11d]: (4, None) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1c331b-e857-4dc1-b571-d7777aaf5c1c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: WARNING nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-181fec50-aed8-46cf-8926-666ba8b4ccad for instance with vm_state active and task_state deleting.
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-unplugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: WARNING nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-41236478-3f4b-4e2e-ae9e-6f0052bfd272 for instance with vm_state active and task_state deleting.
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-unplugged-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-8ef50e3e-aebc-4586-8e02-95e24035c65a for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: WARNING nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-8ef50e3e-aebc-4586-8e02-95e24035c65a for instance with vm_state active and task_state deleting.
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-unplugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: WARNING nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 for instance with vm_state active and task_state deleting.
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-unplugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-unplugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: WARNING nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-d0ff3721-6af3-405f-a239-d7fe1cac99ee for instance with vm_state active and task_state deleting.
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-unplugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3d07ea0-cdc3-442e-887b-2637536b9ec8 req-9971d327-1585-4ea9-9137-51d3192ee51e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b85f6-63ed-444b-9c65-6ca02e372a3c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708, portal: 172.16.0.220,3260]
Nov 14 22:10:15 user nova-compute[76815]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f124d5f0-d226-4185-9f9e-57756d42f708 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.070s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eed9b2-5e10-436d-8044-5ce152e045a2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.512s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] <== disconnect_volume: return (2020ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d9d0ece-3a7c-579b-b245-b7a36c502733', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: INFO os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:58:86,bridge_name='br-int',has_traffic_filtering=True,id=181fec50-aed8-46cf-8926-666ba8b4ccad,network=Network(4564429a-fbb9-49ed-a69f-4bb06e543c65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181fec50-ae')
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:d0,bridge_name='br-int',has_traffic_filtering=True,id=00031166-05b9-413e-814b-3d9ca500dce6,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00031166-05') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:d0,bridge_name='br-int',has_traffic_filtering=True,id=00031166-05b9-413e-814b-3d9ca500dce6,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00031166-05') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00031166-05, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:16 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Instance destroyed successfully.
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lazy-loading 'resources' on Instance uuid 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:cb:e6,bridge_name='br-int',has_traffic_filtering=True,id=891499b5-a743-47f5-be77-20fd703dba98,network=Network(3cfd9c53-400c-4d7e-a306-229b88b184ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891499b5-a7') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:cb:e6,bridge_name='br-int',has_traffic_filtering=True,id=891499b5-a743-47f5-be77-20fd703dba98,network=Network(3cfd9c53-400c-4d7e-a306-229b88b184ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891499b5-a7') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-00031166-05b9-413e-814b-3d9ca500dce6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: WARNING nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-00031166-05b9-413e-814b-3d9ca500dce6 for instance with vm_state active and task_state deleting.
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-unplugged-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-891499b5-a743-47f5-be77-20fd703dba98 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: WARNING nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-891499b5-a743-47f5-be77-20fd703dba98 for instance with vm_state active and task_state deleting.
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-unplugged-faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-faee4c11-33ce-44e5-a8a6-761459aed964 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-faee4c11-33ce-44e5-a8a6-761459aed964 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: WARNING nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-faee4c11-33ce-44e5-a8a6-761459aed964 for instance with vm_state active and task_state deleting.
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-unplugged-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-2918fcad-5d37-4682-945e-c5cda02bcced for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: WARNING nova.compute.manager [req-b4242bfc-c5e4-4258-af18-7578d1e6db1c req-c532cedd-be75-4acd-9b9d-16a59867752e service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-2918fcad-5d37-4682-945e-c5cda02bcced for instance with vm_state active and task_state deleting.
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-plugged-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Acquiring lock "38304882-101f-43c4-8c18-028c609924d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "38304882-101f-43c4-8c18-028c609924d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] No waiting events found dispatching network-vif-plugged-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: WARNING nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received unexpected event network-vif-plugged-a2da1829-8bd3-4b37-85b1-2df590321e79 for instance with vm_state active and task_state deleting.
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-unplugged-f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-f81937c3-cffb-4cb0-8b83-590ed631118f for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-f81937c3-cffb-4cb0-8b83-590ed631118f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: WARNING nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-f81937c3-cffb-4cb0-8b83-590ed631118f for instance with vm_state active and task_state deleting.
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-unplugged-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-9e313244-7f65-4a20-b837-eaa4c9851d0f for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:16 user nova-compute[76815]: WARNING nova.compute.manager [req-967f0be0-9eed-4394-a44a-7cc57ccca05a req-a65938b2-14f1-416f-b014-29313c8050d0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-9e313244-7f65-4a20-b837-eaa4c9851d0f for instance with vm_state active and task_state deleting.
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46306924-6e, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46306924-6e, col_values=(('qos', UUID('42b1424d-86ad-4d5a-b4df-df4ac59e3c37')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46306924-6e, col_values=(('external_ids', {'iface-id': '46306924-6ee9-480c-87a9-6a4a86acaa7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:b3:fb', 'vm-uuid': '16c58923-c97e-4148-af31-9609b9af5d80'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "ab3b7495-76be-421d-9843-af965b815413" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_brick.utils [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[461f0ee8-6222-4d7d-b0d0-f938ad75b3de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13d32dc-d646-462f-808c-b0be3b1d9fe7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be52341-d833-4855-887c-5903e7eb08e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0570e333-93da-407b-b897-a58bdba432c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:10:16 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:10:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d26f6-4464-4c95-9868-e1db139a8b09]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG os_brick.utils [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: INFO os_vif [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e')
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81b9eee0-053a-4ae9-9f67-88094059a614) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:16 user nova-compute[76815]: INFO nova.compute.manager [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] Swapping volume 77f0352b-63c8-4346-8d3c-d25826044d8b for d5daf236-0fb0-4d09-9260-1ac52e92736a
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:10:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] No VIF found with MAC fa:16:3e:3f:b3:fb, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap891499b5-a7, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: INFO os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e4:d0,bridge_name='br-int',has_traffic_filtering=True,id=00031166-05b9-413e-814b-3d9ca500dce6,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00031166-05')
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:ff:88,bridge_name='br-int',has_traffic_filtering=True,id=41236478-3f4b-4e2e-ae9e-6f0052bfd272,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41236478-3f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ff:88,bridge_name='br-int',has_traffic_filtering=True,id=41236478-3f4b-4e2e-ae9e-6f0052bfd272,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41236478-3f') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lazy-loading 'flavor' on Instance uuid a3ba0d7d-48dd-4718-9447-fb632bd1e57b {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41236478-3f, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4885f628-f6f0-4309-a90c-9e341e840078 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.886s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a913889-834f-449d-ba81-dc6856218752) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0234f29b-cd73-484d-896a-2d234044ebe3) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: INFO os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:cb:e6,bridge_name='br-int',has_traffic_filtering=True,id=891499b5-a743-47f5-be77-20fd703dba98,network=Network(3cfd9c53-400c-4d7e-a306-229b88b184ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap891499b5-a7')
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:c6,bridge_name='br-int',has_traffic_filtering=True,id=faee4c11-33ce-44e5-a8a6-761459aed964,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfaee4c11-33') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:c6,bridge_name='br-int',has_traffic_filtering=True,id=faee4c11-33ce-44e5-a8a6-761459aed964,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfaee4c11-33') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfaee4c11-33, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: INFO os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:ff:88,bridge_name='br-int',has_traffic_filtering=True,id=41236478-3f4b-4e2e-ae9e-6f0052bfd272,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap41236478-3f')
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:cd:42,bridge_name='br-int',has_traffic_filtering=True,id=8ef50e3e-aebc-4586-8e02-95e24035c65a,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef50e3e-ae') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:cd:42,bridge_name='br-int',has_traffic_filtering=True,id=8ef50e3e-aebc-4586-8e02-95e24035c65a,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef50e3e-ae') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 2629c515-bd23-4df8-bdfc-4e84c0c06e5a is timed out.
Nov 14 22:10:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Successfully detached device sdc from instance 2629c515-bd23-4df8-bdfc-4e84c0c06e5a from the live domain config.
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jtsvAhyL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:17 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ef50e3e-ae, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae5722c-f99e-4958-9f6d-a047ce0270e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:17 user nova-compute[76815]: No targets found.
Nov 14 22:10:17 user nova-compute[76815]: iSNS:
Nov 14 22:10:17 user nova-compute[76815]: No targets found.
Nov 14 22:10:17 user nova-compute[76815]: STATIC:
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b
Nov 14 22:10:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:17 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:17 user nova-compute[76815]: No targets found.
Nov 14 22:10:17 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:17 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:17 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d98dc48-a3ba-4f14-9b4a-48f28779601f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafa1346-a8b0-41ef-af43-fc9cf561b208]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:17 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:17 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a477f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12973b81-00f1-4d2b-9327-c10e335ca4dd) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[122db998-8b35-446e-9453-f2628883d899]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b97b48-0fae-4594-b68f-b103bf289fdb]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0424e61-583c-4ef7-a4e8-42631cee5fa9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc158fc0-6571-4d1d-a69f-a02cfa8d4baf) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: INFO os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:c6,bridge_name='br-int',has_traffic_filtering=True,id=faee4c11-33ce-44e5-a8a6-761459aed964,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfaee4c11-33')
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=f81937c3-cffb-4cb0-8b83-590ed631118f,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81937c3-cf') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=f81937c3-cffb-4cb0-8b83-590ed631118f,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81937c3-cf') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[54499820-210f-4250-843e-9a5540e51f65]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[049b0404-6d2b-4133-be82-5b702a96b042]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf81937c3-cf, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: INFO os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:cd:42,bridge_name='br-int',has_traffic_filtering=True,id=8ef50e3e-aebc-4586-8e02-95e24035c65a,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef50e3e-ae')
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:8f:d3,bridge_name='br-int',has_traffic_filtering=True,id=a2da1829-8bd3-4b37-85b1-2df590321e79,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2da1829-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8f:d3,bridge_name='br-int',has_traffic_filtering=True,id=a2da1829-8bd3-4b37-85b1-2df590321e79,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2da1829-8b') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[672042e7-a922-4a6c-9d94-1134465fb616]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a, portal: 172.16.0.220,3260]
Nov 14 22:10:17 user nova-compute[76815]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:17 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2da1829-8b, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0852ea66-1fb1-44a5-a65e-912e85a02b7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56fd3a3-0681-4537-80b6-4c14285c18fa]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] <== disconnect_volume: return (360ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c46f9b66-d0b8-4cf2-9902-a30c977953a6) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:17 user nova-compute[76815]: WARNING nova.compute.manager [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 for instance with vm_state active and task_state deleting.
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-unplugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-unplugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-plugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] Acquiring lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] No waiting events found dispatching network-vif-plugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:17 user nova-compute[76815]: WARNING nova.compute.manager [req-bf86a3bd-001e-4e3e-b789-161d5a5bec61 req-76cd7547-0361-42fb-8447-0043cd160621 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received unexpected event network-vif-plugged-f266fb6d-022e-4ea5-aa6b-9837fe489168 for instance with vm_state active and task_state deleting.
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=059142b8-5cfa-4a04-a66e-d3e621befa5a) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: INFO os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:b5,bridge_name='br-int',has_traffic_filtering=True,id=f81937c3-cffb-4cb0-8b83-590ed631118f,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf81937c3-cf')
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:45,bridge_name='br-int',has_traffic_filtering=True,id=6b74bfc3-a532-4083-959f-fe3d0ad3ebf5,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74bfc3-a5') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:45,bridge_name='br-int',has_traffic_filtering=True,id=6b74bfc3-a532-4083-959f-fe3d0ad3ebf5,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74bfc3-a5') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b74bfc3-a5, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: INFO os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:8f:d3,bridge_name='br-int',has_traffic_filtering=True,id=a2da1829-8bd3-4b37-85b1-2df590321e79,network=Network(52355619-f11d-460e-b90f-15a18818d0b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2da1829-8b')
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:90:a7,bridge_name='br-int',has_traffic_filtering=True,id=6619c73b-6c5f-4c4a-b53a-99b80bfb6154,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619c73b-6c') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:90:a7,bridge_name='br-int',has_traffic_filtering=True,id=6619c73b-6c5f-4c4a-b53a-99b80bfb6154,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619c73b-6c') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6619c73b-6c, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46f230bf-d0c0-47b5-ae67-9cbe4ebfe99e) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68067bfb-73b3-4af4-9cae-e1154f4c50eb) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: INFO os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:35:45,bridge_name='br-int',has_traffic_filtering=True,id=6b74bfc3-a532-4083-959f-fe3d0ad3ebf5,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b74bfc3-a5')
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7c:96,bridge_name='br-int',has_traffic_filtering=True,id=2918fcad-5d37-4682-945e-c5cda02bcced,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2918fcad-5d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7c:96,bridge_name='br-int',has_traffic_filtering=True,id=2918fcad-5d37-4682-945e-c5cda02bcced,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2918fcad-5d') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2918fcad-5d, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: INFO os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:90:a7,bridge_name='br-int',has_traffic_filtering=True,id=6619c73b-6c5f-4c4a-b53a-99b80bfb6154,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6619c73b-6c')
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2019218395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2019218395',id=9,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX7ipTXRZVLfMdUkcQ0frwQl6E4Bv+/jMCVvCxLfHHuTQQf/PKurHN5Wopf9fNN9pAR+QoGgMbu799K9VHn6oAM/+ZUDJ2okU4Y3Edp2R+XKPdMkz39QtjJlID+Mf2iJg==',key_name='tempest-keypair-1615885935',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a68a14955fe4688a7e303058c8fba5d',ramdisk_id='',reservation_id='r-07pke0u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-762042002',owner_user_name='tempest-TaggedBootDevicesTest_v242-762042002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5dd134d793c843deaa9fe6928f9df4e5',uuid=38304882-101f-43c4-8c18-028c609924d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converting VIF {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=d0ff3721-6af3-405f-a239-d7fe1cac99ee,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ff3721-6a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=d0ff3721-6af3-405f-a239-d7fe1cac99ee,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ff3721-6a') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ff3721-6a, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e20a0801-418d-4bae-9344-23c91804790b) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebffae86-74d4-4506-9db5-b09b0ca9ab7d) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: INFO os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:7c:96,bridge_name='br-int',has_traffic_filtering=True,id=2918fcad-5d37-4682-945e-c5cda02bcced,network=Network(852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2918fcad-5d')
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b4:f4,bridge_name='br-int',has_traffic_filtering=True,id=9e313244-7f65-4a20-b837-eaa4c9851d0f,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e313244-7f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b4:f4,bridge_name='br-int',has_traffic_filtering=True,id=9e313244-7f65-4a20-b837-eaa4c9851d0f,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e313244-7f') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e313244-7f, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: INFO os_vif [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:6c:ea,bridge_name='br-int',has_traffic_filtering=True,id=d0ff3721-6af3-405f-a239-d7fe1cac99ee,network=Network(c4957f95-3a11-4e52-bbd5-7b5af6a33a6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ff3721-6a')
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXQbsFTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:18 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f26319e-0a2b-4d3b-aa7b-0561891fc4b1) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e4f3d6-72ce-48bd-8db5-a0513db4f62d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:18 user nova-compute[76815]: No targets found.
Nov 14 22:10:18 user nova-compute[76815]: iSNS:
Nov 14 22:10:18 user nova-compute[76815]: No targets found.
Nov 14 22:10:18 user nova-compute[76815]: STATIC:
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b
Nov 14 22:10:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:18 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:18 user nova-compute[76815]: No targets found.
Nov 14 22:10:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:18 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:18 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: INFO os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:b4:f4,bridge_name='br-int',has_traffic_filtering=True,id=9e313244-7f65-4a20-b837-eaa4c9851d0f,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e313244-7f')
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1233902670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1233902670',id=10,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImSXvAPg+Ha+jvnF8HEb5G+LcmTNuUx6Uw8yKGeSOMruAVM50YQvh4gu19z00RGVoSOAT9MN7o5wYkIfnOh4Wx4zhI+0tLIrYvppenryOOSqI2zdXfEfcm3JFCpYouZoA==',key_name='tempest-keypair-1506069471',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28dbae2c095c49008bb5c596305055ed',ramdisk_id='',reservation_id='r-ar2enxbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-71226886',owner_user_name='tempest-TaggedBootDevicesTest-71226886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2ad62182181480ca51d6c5f570f2da9',uuid=13d9a6bb-bfe4-46b2-977b-4f38b746bbfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converting VIF {"id": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "address": "fa:16:3e:ad:29:b8", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf266fb6d-02", "ovs_interfaceid": "f266fb6d-022e-4ea5-aa6b-9837fe489168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:b8,bridge_name='br-int',has_traffic_filtering=True,id=f266fb6d-022e-4ea5-aa6b-9837fe489168,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf266fb6d-02') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:b8,bridge_name='br-int',has_traffic_filtering=True,id=f266fb6d-022e-4ea5-aa6b-9837fe489168,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf266fb6d-02') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf266fb6d-02, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de828682-d968-423f-9e15-34d3cd5fea02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e67dbe43-0efa-42c9-94c1-f38bd12e1dcd) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:18 user nova-compute[76815]: INFO os_vif [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:29:b8,bridge_name='br-int',has_traffic_filtering=True,id=f266fb6d-022e-4ea5-aa6b-9837fe489168,network=Network(cc605c41-baaa-45ed-b20e-fb7bdf37f0e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf266fb6d-02')
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZTYyPBfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:18 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da822f67-2381-498c-9f9d-36bf5755143a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:18 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74d91ef520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8255f30-3840-4a42-b5c3-3bbc11ea1fa9]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9c871a-897a-4b04-ba7a-e8fec26b4a80]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.objects.instance [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lazy-loading 'flavor' on Instance uuid 2629c515-bd23-4df8-bdfc-4e84c0c06e5a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba865035-af92-405b-8e54-7b924b9e5a96]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-32d4a2a5-0c27-4465-9c34-b426aa318195 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.814s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2337665b-7446-40bc-af4d-4d2102792dfe]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c94f871-96e2-4e5d-b40c-f069d7a506d9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5702e8-2bb3-44ac-9d29-0a49b194b64f]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989, portal: 172.16.0.220,3260]
Nov 14 22:10:18 user nova-compute[76815]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:238dec76-05fe-46ce-98de-e10e9d11e989 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e212a1f9-7b52-4cc0-b51c-7e8d8a7ce0f2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] <== disconnect_volume: return (414ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.346s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fnHYpKGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:18 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6475c6-0ba4-4298-8628-4109a87fe2e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:19 user nova-compute[76815]: No targets found.
Nov 14 22:10:19 user nova-compute[76815]: iSNS:
Nov 14 22:10:19 user nova-compute[76815]: No targets found.
Nov 14 22:10:19 user nova-compute[76815]: STATIC:
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:19 user nova-compute[76815]: No targets found.
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:19 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:19 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[43590c5f-c0de-45cf-96c0-0887e5dec973]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[932941e5-20c8-4d5e-a92b-8e150a97b666]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74d91ef7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6'): ({'sdd'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Removing single pathed devices sdd {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0513a2e6-4c7b-487e-9336-929b115ae696]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0b79b4-e274-480d-9fb3-083c719a6ba8]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Flushing IO for device /dev/sdd {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e3cd04-e1ff-4df0-b1b2-bba1d27b975d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d13b5db-6089-4f88-97c2-9b9525f58a42]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] SCSI volumes sdd have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9429da84-d9f4-4a1f-beff-8184380c6b3f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[419b6dcb-7e84-45e4-8dbe-e8e81172aee8]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6, portal: 172.16.0.220,3260]
Nov 14 22:10:19 user nova-compute[76815]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:246fd01d-c901-4337-b731-c811598fa1e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02702e5-add4-42bb-bcb3-ffa93c20c752]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] <== disconnect_volume: return (690ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.343s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ypPhfWud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:19 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf6fb0a-8fa9-4826-8f93-010baf3b58bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:19 user nova-compute[76815]: No targets found.
Nov 14 22:10:19 user nova-compute[76815]: iSNS:
Nov 14 22:10:19 user nova-compute[76815]: No targets found.
Nov 14 22:10:19 user nova-compute[76815]: STATIC:
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:19 user nova-compute[76815]: No targets found.
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:19 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:19 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c85f2-ec7e-404b-ae0d-14e2bcf22e75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[703ee1bc-9a43-4d07-9afc-32d7a9541ce0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a47757e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41'): ({'sde'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Removing single pathed devices sde {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3ea0f7-ee92-4174-90a6-d7011e06bb1c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d90dc6-c5fc-4497-8127-3163cc1d2a54]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Flushing IO for device /dev/sde {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd762bc2-fd11-4e0b-8bbd-54d520ffefce]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d820cd6-36ca-4637-ab6d-482948589ef0]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da84810b-250b-4728-8dfa-072dacadeaeb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24db3bf3-880c-4b5c-a018-6cc64afdcb13]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41, portal: 172.16.0.220,3260]
Nov 14 22:10:19 user nova-compute[76815]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a59b07f-36d8-46f0-8d7a-268d0e381b41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[323ae3d3-2aa3-4d71-bff1-ad4fff0bee80]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] <== disconnect_volume: return (697ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.353s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvjeWpUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:19 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d8ac27-af35-4b0d-9aa9-9c750de881ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:19 user nova-compute[76815]: No targets found.
Nov 14 22:10:19 user nova-compute[76815]: iSNS:
Nov 14 22:10:19 user nova-compute[76815]: No targets found.
Nov 14 22:10:19 user nova-compute[76815]: STATIC:
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b
Nov 14 22:10:19 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:19 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:19 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:19 user nova-compute[76815]: No targets found.
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:19 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:19 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec369e6c-a535-4817-bbc7-f2477dbd818e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c314aea6-77b9-4c31-85d8-e627d9962882]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:19 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a47777f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b'): ({'sdf'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Removing single pathed devices sdf {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3c28bb-2208-4fa1-97be-2d890025ef2d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d2fc3-adef-45e3-88e3-d44cb11f6e09]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Flushing IO for device /dev/sdf {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1678e333-0a16-4e47-98eb-8f1df57495bf]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d98e41-31e8-4814-8d6b-7983e52750a4]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a537c-f60e-40dd-8a34-49d7133572cd]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb53bf59-f24e-4294-8246-3b93d12264dc]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b, portal: 172.16.0.220,3260]
Nov 14 22:10:19 user nova-compute[76815]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:19 user nova-compute[76815]: INFO nova.compute.manager [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Terminating instance
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] No waiting events found dispatching network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:20 user nova-compute[76815]: WARNING nova.compute.manager [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received unexpected event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e for instance with vm_state active and task_state rebuild_spawning.
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] No waiting events found dispatching network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:20 user nova-compute[76815]: WARNING nova.compute.manager [req-6a7abe00-5e7c-4fd9-a6fa-f4169b142ac3 req-d4fcfae3-f348-469d-8ab4-ea1c3b3c4b29 service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received unexpected event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e for instance with vm_state active and task_state rebuild_spawning.
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dcbc826-b341-4c2e-bfef-1b8d906dbe5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7751aa4-8afb-4cae-8a91-475b07c191cf]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] <== disconnect_volume: return (699ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.344s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfkBAmCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:20 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f465eb19-6421-4fec-addc-45256ec67394]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:20 user nova-compute[76815]: No targets found.
Nov 14 22:10:20 user nova-compute[76815]: iSNS:
Nov 14 22:10:20 user nova-compute[76815]: No targets found.
Nov 14 22:10:20 user nova-compute[76815]: STATIC:
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:20 user nova-compute[76815]: No targets found.
Nov 14 22:10:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:20 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:20 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92248801-49f1-4176-9acf-0ebb03696690]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5876b7-af05-4f89-b14f-2418899cffce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74dae2e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b'): ({'sdg'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Removing single pathed devices sdg {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e03604-8eb9-4cc3-a140-b496a10627a2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[82333ed6-779b-41fb-8de1-a77f71962bf9]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Flushing IO for device /dev/sdg {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67289a06-aa65-4c06-a031-f08647d2ff43]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6696ad17-c723-4dc3-a375-df75ab8f9e2d]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] SCSI volumes sdg have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1779aae9-4515-4f99-aaba-3b03b495fef8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance spawned successfully.
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-f8a367de-528b-4857-8d2b-92662ba6ec65 req-fe05fe49-4d34-4e97-ac55-209df5fc33ce service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received event network-vif-unplugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f8a367de-528b-4857-8d2b-92662ba6ec65 req-fe05fe49-4d34-4e97-ac55-209df5fc33ce service nova] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f8a367de-528b-4857-8d2b-92662ba6ec65 req-fe05fe49-4d34-4e97-ac55-209df5fc33ce service nova] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f8a367de-528b-4857-8d2b-92662ba6ec65 req-fe05fe49-4d34-4e97-ac55-209df5fc33ce service nova] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-f8a367de-528b-4857-8d2b-92662ba6ec65 req-fe05fe49-4d34-4e97-ac55-209df5fc33ce service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] No waiting events found dispatching network-vif-unplugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-f8a367de-528b-4857-8d2b-92662ba6ec65 req-fe05fe49-4d34-4e97-ac55-209df5fc33ce service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received event network-vif-unplugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a0ba3-9c68-481e-b614-fb687344ff48]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b, portal: 172.16.0.220,3260]
Nov 14 22:10:20 user nova-compute[76815]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1200f02-ea6b-4100-8310-32379061188b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f8d2b6-7fa5-4b25-bd5f-322751077e44]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] <== disconnect_volume: return (716ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Deleting instance files /opt/stack/data/nova/instances/38304882-101f-43c4-8c18-028c609924d3_del
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Deletion of /opt/stack/data/nova/instances/38304882-101f-43c4-8c18-028c609924d3_del complete
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.372s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fcb6a7-eb87-470d-9014-bd5bc2dae969]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:20 user nova-compute[76815]: No targets found.
Nov 14 22:10:20 user nova-compute[76815]: iSNS:
Nov 14 22:10:20 user nova-compute[76815]: No targets found.
Nov 14 22:10:20 user nova-compute[76815]: STATIC:
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:20 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:20 user nova-compute[76815]: No targets found.
Nov 14 22:10:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:20 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:20 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91a5f24-cc3a-491c-973b-4e41037f99e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.compute.manager [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Took 7.04 seconds to destroy the instance on the hypervisor.
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 38304882-101f-43c4-8c18-028c609924d3] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 38304882-101f-43c4-8c18-028c609924d3] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bdb034-035a-4364-883f-f79a109bf9b9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:20 user nova-compute[76815]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 (non-flash)
Nov 14 22:10:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a47751b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8'): ({'sdh'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Removing single pathed devices sdh {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c60b2d6-6abb-49e1-9f19-b6c8122ed46f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2e85c1-e7a7-466a-931c-ca352520456e]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Flushing IO for device /dev/sdh {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.objects.instance [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76815) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e41ff4-3ddf-41e9-af72-18a577730604]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6bf18e-167c-4aa6-910c-fdbbd532091f]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] SCSI volumes sdh have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[642f9b25-8eb9-4cf0-ad98-4082a430b814]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cf947752-64ff-4f79-895a-382634f0c5b6 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.090s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee4826f-72a4-4033-8a41-8992a310e222]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8, portal: 172.16.0.220,3260]
Nov 14 22:10:20 user nova-compute[76815]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8fc24f5-8c46-4c9f-bd31-cccdeb4720b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e57b422-8cfd-4a74-b690-c88a8f011273]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] <== disconnect_volume: return (734ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Deleting instance files /opt/stack/data/nova/instances/13d9a6bb-bfe4-46b2-977b-4f38b746bbfa_del
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Deletion of /opt/stack/data/nova/instances/13d9a6bb-bfe4-46b2-977b-4f38b746bbfa_del complete
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Instance destroyed successfully.
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lazy-loading 'resources' on Instance uuid 2629c515-bd23-4df8-bdfc-4e84c0c06e5a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-692357177',display_name='tempest-AttachSCSIVolumeTestJSON-server-692357177',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-692357177',id=4,image_ref='67d3cd1b-dcdc-4323-9b14-42851ba967c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiGnL1DwEH0XOO6wP5AWOdeonAHQyPqZ/53Pb9j1U2Bw+Cd9oenz6v6RCdhe8cMGrrgvZXT4FQjn7zeCu0yx7IAOpfNRMx35sUub7peU+4eoYF8WVv7p1o0PiLu3uNFeg==',key_name='tempest-keypair-1798601504',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d468f624a3d4526ab4422c7a1bea2f0',ramdisk_id='',reservation_id='r-o17c1xvh',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='67d3cd1b-dcdc-4323-9b14-42851ba967c5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1478825930',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1478825930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6851a124ff8e4fe6a08810a8b257eff7',uuid=2629c515-bd23-4df8-bdfc-4e84c0c06e5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Converting VIF {"id": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "address": "fa:16:3e:c4:c9:12", "network": {"id": "18880a12-34d7-461a-b276-40f81a2d5769", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1379080948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d468f624a3d4526ab4422c7a1bea2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap620ab99e-0a", "ovs_interfaceid": "620ab99e-0aa9-4b39-9963-dc38976df1f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:c9:12,bridge_name='br-int',has_traffic_filtering=True,id=620ab99e-0aa9-4b39-9963-dc38976df1f4,network=Network(18880a12-34d7-461a-b276-40f81a2d5769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620ab99e-0a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG os_vif [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:c9:12,bridge_name='br-int',has_traffic_filtering=True,id=620ab99e-0aa9-4b39-9963-dc38976df1f4,network=Network(18880a12-34d7-461a-b276-40f81a2d5769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620ab99e-0a') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap620ab99e-0a, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be45b487-9c22-4a59-a9bb-a9e6cdca4133) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:20 user nova-compute[76815]: INFO os_vif [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:c9:12,bridge_name='br-int',has_traffic_filtering=True,id=620ab99e-0aa9-4b39-9963-dc38976df1f4,network=Network(18880a12-34d7-461a-b276-40f81a2d5769),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap620ab99e-0a')
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Deleting instance files /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a_del
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Deletion of /opt/stack/data/nova/instances/2629c515-bd23-4df8-bdfc-4e84c0c06e5a_del complete
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.compute.manager [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Took 6.49 seconds to destroy the instance on the hypervisor.
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:10:20 user nova-compute[76815]: INFO nova.compute.manager [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 22:10:20 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:10:20 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:10:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:21 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:21 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Took 1.03 seconds to deallocate network for instance.
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqrJDINa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab3b7495-76be-421d-9843-af965b815413', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5daf236-0fb0-4d09-9260-1ac52e92736a', 'serial': 'd5daf236-0fb0-4d09-9260-1ac52e92736a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgmAjBPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '77f0352b-63c8-4346-8d3c-d25826044d8b'}, 'status': 'reserved', 'instance': 'ab3b7495-76be-421d-9843-af965b815413', 'attached_at': '', 'detached_at': '', 'volume_id': '77f0352b-63c8-4346-8d3c-d25826044d8b', 'serial'} {{(pid=76815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqrJDINa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:22 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:22 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:22 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[812e61cc-4ef7-4953-8036-4fa1c2bda4ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:10:22 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aa1640-3573-4681-bbbd-16a7c0aaf6fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a] added
Nov 14 22:10:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b84398-3816-42a1-8f4e-b001bb02dac7]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a0380d-158a-48d1-926e-ffdb27e6368f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqrJDINa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BqrJDINa" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86cefa4-eea4-4ea1-8774-933b1f57608d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-80d4f4bd-27bc-432f-bce9-1e094140de63 req-5f8b2323-c3f8-40bd-9bac-51958efb8d8d service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received event network-vif-plugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-80d4f4bd-27bc-432f-bce9-1e094140de63 req-5f8b2323-c3f8-40bd-9bac-51958efb8d8d service nova] Acquiring lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-80d4f4bd-27bc-432f-bce9-1e094140de63 req-5f8b2323-c3f8-40bd-9bac-51958efb8d8d service nova] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-80d4f4bd-27bc-432f-bce9-1e094140de63 req-5f8b2323-c3f8-40bd-9bac-51958efb8d8d service nova] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-80d4f4bd-27bc-432f-bce9-1e094140de63 req-5f8b2323-c3f8-40bd-9bac-51958efb8d8d service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] No waiting events found dispatching network-vif-plugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:22 user nova-compute[76815]: WARNING nova.compute.manager [req-80d4f4bd-27bc-432f-bce9-1e094140de63 req-5f8b2323-c3f8-40bd-9bac-51958efb8d8d service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received unexpected event network-vif-plugged-620ab99e-0aa9-4b39-9963-dc38976df1f4 for instance with vm_state deleted and task_state None.
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-80d4f4bd-27bc-432f-bce9-1e094140de63 req-5f8b2323-c3f8-40bd-9bac-51958efb8d8d service nova] [instance: 2629c515-bd23-4df8-bdfc-4e84c0c06e5a] Received event network-vif-deleted-620ab99e-0aa9-4b39-9963-dc38976df1f4 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BqrJDINa'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2625c9d0-68ec-4397-9a10-fe0f9175cb6d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23537d8-07d3-4fe1-9d5a-1d4120207315]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:22 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Deleted allocations for instance 2629c515-bd23-4df8-bdfc-4e84c0c06e5a
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37cae62-5769-4188-8460-86db5ef9d48e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260]
Nov 14 22:10:22 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8f691e-62b9-4b7c-b1bb-5bc1892ff200]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[71732399-1027-4012-894d-b4469223882a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:22 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.037s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[532655df-4dcc-4c26-bc60-e69ffc50e75a]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqrJDINa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2494a841-9bde-4f45-80ff-71cea0264881 tempest-AttachSCSIVolumeTestJSON-1478825930 tempest-AttachSCSIVolumeTestJSON-1478825930-project-member] Lock "2629c515-bd23-4df8-bdfc-4e84c0c06e5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.752s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-18cb7dc7-5301-499f-b516-6512735f827d req-627d6fef-4e3d-481b-87c2-f40afb03df6f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-deleted-181fec50-aed8-46cf-8926-666ba8b4ccad {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:22 user nova-compute[76815]: INFO nova.compute.manager [req-18cb7dc7-5301-499f-b516-6512735f827d req-627d6fef-4e3d-481b-87c2-f40afb03df6f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Neutron deleted interface 181fec50-aed8-46cf-8926-666ba8b4ccad; detaching it from the instance and deleting it from the info cache
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.network.neutron [req-18cb7dc7-5301-499f-b516-6512735f827d req-627d6fef-4e3d-481b-87c2-f40afb03df6f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [{"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2da1829-8bd3-4b37-85b1-2df590321e79", "address": "fa:16:3e:86:8f:d3", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2da1829-8b", "ovs_interfaceid": "a2da1829-8bd3-4b37-85b1-2df590321e79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-18cb7dc7-5301-499f-b516-6512735f827d req-627d6fef-4e3d-481b-87c2-f40afb03df6f service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Detach interface failed, port_id=181fec50-aed8-46cf-8926-666ba8b4ccad, reason: Instance 38304882-101f-43c4-8c18-028c609924d3 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-e7f5af63-139b-4ef9-9c13-142bd4ccd824 req-90323890-c5d6-4626-8061-e0661cf368b0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-deleted-f266fb6d-022e-4ea5-aa6b-9837fe489168 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:22 user nova-compute[76815]: INFO nova.compute.manager [req-e7f5af63-139b-4ef9-9c13-142bd4ccd824 req-90323890-c5d6-4626-8061-e0661cf368b0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Neutron deleted interface f266fb6d-022e-4ea5-aa6b-9837fe489168; detaching it from the instance and deleting it from the info cache
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.network.neutron [req-e7f5af63-139b-4ef9-9c13-142bd4ccd824 req-90323890-c5d6-4626-8061-e0661cf368b0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [{"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2918fcad-5d37-4682-945e-c5cda02bcced", "address": "fa:16:3e:e2:7c:96", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2918fcad-5d", "ovs_interfaceid": "2918fcad-5d37-4682-945e-c5cda02bcced", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-e7f5af63-139b-4ef9-9c13-142bd4ccd824 req-90323890-c5d6-4626-8061-e0661cf368b0 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Detach interface failed, port_id=f266fb6d-022e-4ea5-aa6b-9837fe489168, reason: Instance 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:10:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '26566383938383664', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566383938383664', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:10:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lazy-loading 'flavor' on Instance uuid ab3b7495-76be-421d-9843-af965b815413 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:24 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 is timed out.
Nov 14 22:10:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Successfully detached device vdb from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 from the live domain config.
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfhtJVRp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:24 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc442ec5-39db-42d8-938b-4e23d5454964]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:24 user nova-compute[76815]: No targets found.
Nov 14 22:10:24 user nova-compute[76815]: iSNS:
Nov 14 22:10:24 user nova-compute[76815]: No targets found.
Nov 14 22:10:24 user nova-compute[76815]: STATIC:
Nov 14 22:10:24 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:24 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:24 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:24 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:24 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:24 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:24 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd
Nov 14 22:10:24 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:24 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:24 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a
Nov 14 22:10:24 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:24 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:24 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:24 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:24 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:24 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:24 user nova-compute[76815]: No targets found.
Nov 14 22:10:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:24 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:24 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c59197-f66d-4ba9-b08b-539b126d9e2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f4b868-891c-4700-ac21-48787848e822]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:24 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:24 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:24 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:24 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd (non-flash)
Nov 14 22:10:24 user nova-compute[76815]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:24 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:24 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:24 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8628dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd'): ({'sdl'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Removing single pathed devices sdl {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.167s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[299f87c8-7e6c-4e72-9645-bee46d39444e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b772d52b-6ed7-4fce-be07-c7afe81ead6f]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Flushing IO for device /dev/sdl {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7efd992-d3f0-4b3a-817c-237567a5b958]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f96c363-e62f-4151-8f9c-b2aed72a7180]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] SCSI volumes sdl have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3add3b-85a1-41a2-aea0-05638dadf3ab]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe2a5df-03b9-46d7-95d8-55b6224a5e68]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd, portal: 172.16.0.220,3260]
Nov 14 22:10:24 user nova-compute[76815]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19379099-45a5-4b41-aefc-0233ad0222fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0604ff6d-7724-406e-8b9b-1cb8b4c4104b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.537s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] <== disconnect_volume: return (538ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-deleted-a2da1829-8bd3-4b37-85b1-2df590321e79 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:24 user nova-compute[76815]: INFO nova.compute.manager [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Neutron deleted interface a2da1829-8bd3-4b37-85b1-2df590321e79; detaching it from the instance and deleting it from the info cache
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.network.neutron [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [{"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "address": "fa:16:3e:a7:90:a7", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6619c73b-6c", "ovs_interfaceid": "6619c73b-6c5f-4c4a-b53a-99b80bfb6154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Detach interface failed, port_id=a2da1829-8bd3-4b37-85b1-2df590321e79, reason: Instance 38304882-101f-43c4-8c18-028c609924d3 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-deleted-6619c73b-6c5f-4c4a-b53a-99b80bfb6154 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:24 user nova-compute[76815]: INFO nova.compute.manager [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Neutron deleted interface 6619c73b-6c5f-4c4a-b53a-99b80bfb6154; detaching it from the instance and deleting it from the info cache
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.network.neutron [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [{"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "address": "fa:16:3e:2a:cd:42", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef50e3e-ae", "ovs_interfaceid": "8ef50e3e-aebc-4586-8e02-95e24035c65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Detach interface failed, port_id=6619c73b-6c5f-4c4a-b53a-99b80bfb6154, reason: Instance 38304882-101f-43c4-8c18-028c609924d3 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-deleted-8ef50e3e-aebc-4586-8e02-95e24035c65a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:24 user nova-compute[76815]: INFO nova.compute.manager [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Neutron deleted interface 8ef50e3e-aebc-4586-8e02-95e24035c65a; detaching it from the instance and deleting it from the info cache
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.network.neutron [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [{"id": "00031166-05b9-413e-814b-3d9ca500dce6", "address": "fa:16:3e:c2:e4:d0", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00031166-05", "ovs_interfaceid": "00031166-05b9-413e-814b-3d9ca500dce6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "address": "fa:16:3e:28:ff:88", "network": {"id": "52355619-f11d-460e-b90f-15a18818d0b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-501006214", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41236478-3f", "ovs_interfaceid": "41236478-3f4b-4e2e-ae9e-6f0052bfd272", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "address": "fa:16:3e:fc:6c:ea", "network": {"id": "c4957f95-3a11-4e52-bbd5-7b5af6a33a6e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1877938896", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a68a14955fe4688a7e303058c8fba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ff3721-6a", "ovs_interfaceid": "d0ff3721-6af3-405f-a239-d7fe1cac99ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-2a26af12-620c-4f27-8062-0511798b82a8 req-686a9717-5a51-4784-8ce0-25095bfa3a46 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Detach interface failed, port_id=8ef50e3e-aebc-4586-8e02-95e24035c65a, reason: Instance 38304882-101f-43c4-8c18-028c609924d3 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-2ed1e734-3e9d-4dd9-b43b-d7bd3408c30b req-1b1a335a-b689-434f-a2f7-a01e9c5787d3 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-deleted-2918fcad-5d37-4682-945e-c5cda02bcced {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:25 user nova-compute[76815]: INFO nova.compute.manager [req-2ed1e734-3e9d-4dd9-b43b-d7bd3408c30b req-1b1a335a-b689-434f-a2f7-a01e9c5787d3 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Neutron deleted interface 2918fcad-5d37-4682-945e-c5cda02bcced; detaching it from the instance and deleting it from the info cache
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.network.neutron [req-2ed1e734-3e9d-4dd9-b43b-d7bd3408c30b req-1b1a335a-b689-434f-a2f7-a01e9c5787d3 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [{"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "address": "fa:16:3e:8d:b4:f4", "network": {"id": "cc605c41-baaa-45ed-b20e-fb7bdf37f0e3", "bridge": "br-int", "label": "tempest-device-tagging-net2-40061621", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e313244-7f", "ovs_interfaceid": "9e313244-7f65-4a20-b837-eaa4c9851d0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 38304882-101f-43c4-8c18-028c609924d3] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:25 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 38304882-101f-43c4-8c18-028c609924d3] Took 4.53 seconds to deallocate network for instance.
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-2ed1e734-3e9d-4dd9-b43b-d7bd3408c30b req-1b1a335a-b689-434f-a2f7-a01e9c5787d3 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Detach interface failed, port_id=2918fcad-5d37-4682-945e-c5cda02bcced, reason: Instance 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-2ed1e734-3e9d-4dd9-b43b-d7bd3408c30b req-1b1a335a-b689-434f-a2f7-a01e9c5787d3 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-deleted-9e313244-7f65-4a20-b837-eaa4c9851d0f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:25 user nova-compute[76815]: INFO nova.compute.manager [req-2ed1e734-3e9d-4dd9-b43b-d7bd3408c30b req-1b1a335a-b689-434f-a2f7-a01e9c5787d3 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Neutron deleted interface 9e313244-7f65-4a20-b837-eaa4c9851d0f; detaching it from the instance and deleting it from the info cache
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.network.neutron [req-2ed1e734-3e9d-4dd9-b43b-d7bd3408c30b req-1b1a335a-b689-434f-a2f7-a01e9c5787d3 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [{"id": "891499b5-a743-47f5-be77-20fd703dba98", "address": "fa:16:3e:b8:cb:e6", "network": {"id": "3cfd9c53-400c-4d7e-a306-229b88b184ad", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1876841084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap891499b5-a7", "ovs_interfaceid": "891499b5-a743-47f5-be77-20fd703dba98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "faee4c11-33ce-44e5-a8a6-761459aed964", "address": "fa:16:3e:77:21:c6", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfaee4c11-33", "ovs_interfaceid": "faee4c11-33ce-44e5-a8a6-761459aed964", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f81937c3-cffb-4cb0-8b83-590ed631118f", "address": "fa:16:3e:73:a2:b5", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf81937c3-cf", "ovs_interfaceid": "f81937c3-cffb-4cb0-8b83-590ed631118f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "address": "fa:16:3e:38:35:45", "network": {"id": "852ba9e3-98e1-4c2e-ad68-992c1f0a4ea1", "bridge": "br-int", "label": "tempest-device-tagging-net1-486888681", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "28dbae2c095c49008bb5c596305055ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b74bfc3-a5", "ovs_interfaceid": "6b74bfc3-a532-4083-959f-fe3d0ad3ebf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-2ed1e734-3e9d-4dd9-b43b-d7bd3408c30b req-1b1a335a-b689-434f-a2f7-a01e9c5787d3 service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Detach interface failed, port_id=9e313244-7f65-4a20-b837-eaa4c9851d0f, reason: Instance 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 207618048 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lazy-loading 'flavor' on Instance uuid 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:25 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:26 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Took 5.13 seconds to deallocate network for instance.
Nov 14 22:10:26 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 278921216 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3db748a0-8c6e-40c6-83ac-e23a560dc6f8 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.793s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:10:26 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 347078656 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:26 user nova-compute[76815]: DEBUG nova.compute.manager [req-f098a934-b472-4e17-ba88-c7ecd488cb53 req-50af95d6-9df5-425a-a57e-212c99fa2a71 service nova] [instance: 38304882-101f-43c4-8c18-028c609924d3] Received event network-vif-deleted-d0ff3721-6af3-405f-a239-d7fe1cac99ee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "interface-91830a3a-8395-4f82-81c3-6aec79a46c33-e02f16bb-de13-4564-960f-d0c3991cff42" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "interface-91830a3a-8395-4f82-81c3-6aec79a46c33-e02f16bb-de13-4564-960f-d0c3991cff42" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.objects.instance [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lazy-loading 'flavor' on Instance uuid 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 347078656 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239797802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239797802',id=6,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp1I2ExuD5M3u6m5DSKi2h8Sbi9eJkAW82TUikZkZ6/CmyHFgzEt+tH3XphSvsi+i6IpnxEg23xGXTPTV8VZcAvDG1z9g4zldZJtkz5P+3Huuf8Uxsjfoa/XNo/Ex9vg==',key_name='tempest-keypair-1648996082',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f304c47366c4cd1af23a1f0d43d8825',ramdisk_id='',reservation_id='r-m3vhi65s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1610929038',owner_user_name='tempest-TaggedAttachmentsTest-1610929038-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3356e497cd5243beb1e6d5aa0b24a177',uuid=91830a3a-8395-4f82-81c3-6aec79a46c33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converting VIF {"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:98,bridge_name='br-int',has_traffic_filtering=True,id=e02f16bb-de13-4564-960f-d0c3991cff42,network=Network(ab9efc23-9077-40ac-ab20-e2d565885001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02f16bb-de') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-b1623f80-c30d-445f-a675-1276b450e5cc req-032c800a-1b38-4c15-8e47-b526188ba98d service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-deleted-891499b5-a743-47f5-be77-20fd703dba98 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-b1623f80-c30d-445f-a675-1276b450e5cc req-032c800a-1b38-4c15-8e47-b526188ba98d service nova] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Received event network-vif-deleted-6b74bfc3-a532-4083-959f-fe3d0ad3ebf5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:9b:98"/><model type="virtio"/><mtu size="1442"/><target dev="tape02f16bb-de"/></interface> {{(pid=76815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:9b:98"/><model type="virtio"/><mtu size="1442"/><target dev="tape02f16bb-de"/></interface> {{(pid=76815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Attempting to detach device tape02f16bb-de from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] detach device xml: <interface type="ethernet">
Nov 14 22:10:27 user nova-compute[76815]:   <mac address="fa:16:3e:47:9b:98"/>
Nov 14 22:10:27 user nova-compute[76815]:   <model type="virtio"/>
Nov 14 22:10:27 user nova-compute[76815]:   <mtu size="1442"/>
Nov 14 22:10:27 user nova-compute[76815]:   <target dev="tape02f16bb-de"/>
Nov 14 22:10:27 user nova-compute[76815]: </interface>
Nov 14 22:10:27 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:9b:98"/><model type="virtio"/><mtu size="1442"/><target dev="tape02f16bb-de"/></interface> {{(pid=76815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:9b:98"/><model type="virtio"/><mtu size="1442"/><target dev="tape02f16bb-de"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 14 22:10:27 user nova-compute[76815]:   <name>instance-00000006</name>
Nov 14 22:10:27 user nova-compute[76815]:   <uuid>91830a3a-8395-4f82-81c3-6aec79a46c33</uuid>
Nov 14 22:10:27 user nova-compute[76815]:   <metadata>
Nov 14 22:10:27 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:10:27 user nova-compute[76815]:   <nova:package version="0.0.0"/>
Nov 14 22:10:27 user nova-compute[76815]:   <nova:name>tempest-device-tagging-server-239797802</nova:name>
Nov 14 22:10:27 user nova-compute[76815]:   <nova:creationTime>2023-11-14 22:09:54</nova:creationTime>
Nov 14 22:10:27 user nova-compute[76815]:   <nova:flavor name="m1.tiny">
Nov 14 22:10:27 user nova-compute[76815]:     <nova:memory>512</nova:memory>
Nov 14 22:10:27 user nova-compute[76815]:     <nova:disk>1</nova:disk>
Nov 14 22:10:27 user nova-compute[76815]:     <nova:swap>0</nova:swap>
Nov 14 22:10:27 user nova-compute[76815]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:10:27 user nova-compute[76815]:     <nova:vcpus>1</nova:vcpus>
Nov 14 22:10:27 user nova-compute[76815]:   </nova:flavor>
Nov 14 22:10:27 user nova-compute[76815]:   <nova:owner>
Nov 14 22:10:27 user nova-compute[76815]:     <nova:user uuid="3356e497cd5243beb1e6d5aa0b24a177">tempest-TaggedAttachmentsTest-1610929038-project-member</nova:user>
Nov 14 22:10:27 user nova-compute[76815]:     <nova:project uuid="3f304c47366c4cd1af23a1f0d43d8825">tempest-TaggedAttachmentsTest-1610929038</nova:project>
Nov 14 22:10:27 user nova-compute[76815]:   </nova:owner>
Nov 14 22:10:27 user nova-compute[76815]:   <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:10:27 user nova-compute[76815]:   <nova:ports>
Nov 14 22:10:27 user nova-compute[76815]:     <nova:port uuid="5688ed4c-da6e-445f-9839-2d49c9724bc8">
Nov 14 22:10:27 user nova-compute[76815]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:10:27 user nova-compute[76815]:     </nova:port>
Nov 14 22:10:27 user nova-compute[76815]:     <nova:port uuid="e02f16bb-de13-4564-960f-d0c3991cff42">
Nov 14 22:10:27 user nova-compute[76815]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Nov 14 22:10:27 user nova-compute[76815]:     </nova:port>
Nov 14 22:10:27 user nova-compute[76815]:   </nova:ports>
Nov 14 22:10:27 user nova-compute[76815]: </nova:instance>
Nov 14 22:10:27 user nova-compute[76815]:   </metadata>
Nov 14 22:10:27 user nova-compute[76815]:   <memory unit='KiB'>524288</memory>
Nov 14 22:10:27 user nova-compute[76815]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 22:10:27 user nova-compute[76815]:   <vcpu placement='static'>1</vcpu>
Nov 14 22:10:27 user nova-compute[76815]:   <resource>
Nov 14 22:10:27 user nova-compute[76815]:     <partition>/machine</partition>
Nov 14 22:10:27 user nova-compute[76815]:   </resource>
Nov 14 22:10:27 user nova-compute[76815]:   <sysinfo type='smbios'>
Nov 14 22:10:27 user nova-compute[76815]:     <system>
Nov 14 22:10:27 user nova-compute[76815]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 22:10:27 user nova-compute[76815]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 22:10:27 user nova-compute[76815]:       <entry name='version'>0.0.0</entry>
Nov 14 22:10:27 user nova-compute[76815]:       <entry name='serial'>91830a3a-8395-4f82-81c3-6aec79a46c33</entry>
Nov 14 22:10:27 user nova-compute[76815]:       <entry name='uuid'>91830a3a-8395-4f82-81c3-6aec79a46c33</entry>
Nov 14 22:10:27 user nova-compute[76815]:       <entry name='family'>Virtual Machine</entry>
Nov 14 22:10:27 user nova-compute[76815]:     </system>
Nov 14 22:10:27 user nova-compute[76815]:   </sysinfo>
Nov 14 22:10:27 user nova-compute[76815]:   <os>
Nov 14 22:10:27 user nova-compute[76815]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 22:10:27 user nova-compute[76815]:     <boot dev='hd'/>
Nov 14 22:10:27 user nova-compute[76815]:     <smbios mode='sysinfo'/>
Nov 14 22:10:27 user nova-compute[76815]:   </os>
Nov 14 22:10:27 user nova-compute[76815]:   <features>
Nov 14 22:10:27 user nova-compute[76815]:     <acpi/>
Nov 14 22:10:27 user nova-compute[76815]:     <apic/>
Nov 14 22:10:27 user nova-compute[76815]:     <vmcoreinfo state='on'/>
Nov 14 22:10:27 user nova-compute[76815]:   </features>
Nov 14 22:10:27 user nova-compute[76815]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 22:10:27 user nova-compute[76815]:     <model fallback='forbid'>Nehalem</model>
Nov 14 22:10:27 user nova-compute[76815]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 22:10:27 user nova-compute[76815]:     <feature policy='require' name='vme'/>
Nov 14 22:10:27 user nova-compute[76815]:     <feature policy='require' name='x2apic'/>
Nov 14 22:10:27 user nova-compute[76815]:     <feature policy='require' name='hypervisor'/>
Nov 14 22:10:27 user nova-compute[76815]:   </cpu>
Nov 14 22:10:27 user nova-compute[76815]:   <clock offset='utc'>
Nov 14 22:10:27 user nova-compute[76815]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 22:10:27 user nova-compute[76815]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 22:10:27 user nova-compute[76815]:     <timer name='hpet' present='no'/>
Nov 14 22:10:27 user nova-compute[76815]:   </clock>
Nov 14 22:10:27 user nova-compute[76815]:   <on_poweroff>destroy</on_poweroff>
Nov 14 22:10:27 user nova-compute[76815]:   <on_reboot>restart</on_reboot>
Nov 14 22:10:27 user nova-compute[76815]:   <on_crash>destroy</on_crash>
Nov 14 22:10:27 user nova-compute[76815]:   <devices>
Nov 14 22:10:27 user nova-compute[76815]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 22:10:27 user nova-compute[76815]:     <disk type='file' device='disk'>
Nov 14 22:10:27 user nova-compute[76815]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 22:10:27 user nova-compute[76815]:       <source file='/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk' index='2'/>
Nov 14 22:10:27 user nova-compute[76815]:       <backingStore type='file' index='3'>
Nov 14 22:10:27 user nova-compute[76815]:         <format type='raw'/>
Nov 14 22:10:27 user nova-compute[76815]:         <source file='/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b'/>
Nov 14 22:10:27 user nova-compute[76815]:         <backingStore/>
Nov 14 22:10:27 user nova-compute[76815]:       </backingStore>
Nov 14 22:10:27 user nova-compute[76815]:       <target dev='vda' bus='virtio'/>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='virtio-disk0'/>
Nov 14 22:10:27 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </disk>
Nov 14 22:10:27 user nova-compute[76815]:     <disk type='file' device='cdrom'>
Nov 14 22:10:27 user nova-compute[76815]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 22:10:27 user nova-compute[76815]:       <source file='/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk.config' index='1'/>
Nov 14 22:10:27 user nova-compute[76815]:       <backingStore/>
Nov 14 22:10:27 user nova-compute[76815]:       <target dev='hda' bus='ide'/>
Nov 14 22:10:27 user nova-compute[76815]:       <readonly/>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='ide0-0-0'/>
Nov 14 22:10:27 user nova-compute[76815]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </disk>
Nov 14 22:10:27 user nova-compute[76815]:     <controller type='usb' index='0' model='none'>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='usb'/>
Nov 14 22:10:27 user nova-compute[76815]:     </controller>
Nov 14 22:10:27 user nova-compute[76815]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='pci.0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </controller>
Nov 14 22:10:27 user nova-compute[76815]:     <controller type='ide' index='0'>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='ide'/>
Nov 14 22:10:27 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 22:10:27 user nova-compute[76815]:     </controller>
Nov 14 22:10:27 user nova-compute[76815]:     <interface type='ethernet'>
Nov 14 22:10:27 user nova-compute[76815]:       <mac address='fa:16:3e:21:d0:50'/>
Nov 14 22:10:27 user nova-compute[76815]:       <target dev='tap5688ed4c-da'/>
Nov 14 22:10:27 user nova-compute[76815]:       <model type='virtio'/>
Nov 14 22:10:27 user nova-compute[76815]:       <mtu size='1442'/>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='net0'/>
Nov 14 22:10:27 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </interface>
Nov 14 22:10:27 user nova-compute[76815]:     <interface type='ethernet'>
Nov 14 22:10:27 user nova-compute[76815]:       <mac address='fa:16:3e:47:9b:98'/>
Nov 14 22:10:27 user nova-compute[76815]:       <target dev='tape02f16bb-de'/>
Nov 14 22:10:27 user nova-compute[76815]:       <model type='virtio'/>
Nov 14 22:10:27 user nova-compute[76815]:       <mtu size='1442'/>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='net1'/>
Nov 14 22:10:27 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </interface>
Nov 14 22:10:27 user nova-compute[76815]:     <serial type='pty'>
Nov 14 22:10:27 user nova-compute[76815]:       <source path='/dev/pts/4'/>
Nov 14 22:10:27 user nova-compute[76815]:       <log file='/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/console.log' append='off'/>
Nov 14 22:10:27 user nova-compute[76815]:       <target type='isa-serial' port='0'>
Nov 14 22:10:27 user nova-compute[76815]:         <model name='isa-serial'/>
Nov 14 22:10:27 user nova-compute[76815]:       </target>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='serial0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </serial>
Nov 14 22:10:27 user nova-compute[76815]:     <console type='pty' tty='/dev/pts/4'>
Nov 14 22:10:27 user nova-compute[76815]:       <source path='/dev/pts/4'/>
Nov 14 22:10:27 user nova-compute[76815]:       <log file='/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/console.log' append='off'/>
Nov 14 22:10:27 user nova-compute[76815]:       <target type='serial' port='0'/>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='serial0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </console>
Nov 14 22:10:27 user nova-compute[76815]:     <input type='mouse' bus='ps2'>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='input0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </input>
Nov 14 22:10:27 user nova-compute[76815]:     <input type='keyboard' bus='ps2'>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='input1'/>
Nov 14 22:10:27 user nova-compute[76815]:     </input>
Nov 14 22:10:27 user nova-compute[76815]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 14 22:10:27 user nova-compute[76815]:       <listen type='address' address='0.0.0.0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </graphics>
Nov 14 22:10:27 user nova-compute[76815]:     <audio id='1' type='none'/>
Nov 14 22:10:27 user nova-compute[76815]:     <video>
Nov 14 22:10:27 user nova-compute[76815]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='video0'/>
Nov 14 22:10:27 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </video>
Nov 14 22:10:27 user nova-compute[76815]:     <memballoon model='virtio'>
Nov 14 22:10:27 user nova-compute[76815]:       <stats period='10'/>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='balloon0'/>
Nov 14 22:10:27 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </memballoon>
Nov 14 22:10:27 user nova-compute[76815]:     <rng model='virtio'>
Nov 14 22:10:27 user nova-compute[76815]:       <backend model='random'>/dev/urandom</backend>
Nov 14 22:10:27 user nova-compute[76815]:       <alias name='rng0'/>
Nov 14 22:10:27 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 22:10:27 user nova-compute[76815]:     </rng>
Nov 14 22:10:27 user nova-compute[76815]:   </devices>
Nov 14 22:10:27 user nova-compute[76815]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 22:10:27 user nova-compute[76815]:     <label>libvirt-91830a3a-8395-4f82-81c3-6aec79a46c33</label>
Nov 14 22:10:27 user nova-compute[76815]:     <imagelabel>libvirt-91830a3a-8395-4f82-81c3-6aec79a46c33</imagelabel>
Nov 14 22:10:27 user nova-compute[76815]:   </seclabel>
Nov 14 22:10:27 user nova-compute[76815]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 22:10:27 user nova-compute[76815]:     <label>+64055:+108</label>
Nov 14 22:10:27 user nova-compute[76815]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 22:10:27 user nova-compute[76815]:   </seclabel>
Nov 14 22:10:27 user nova-compute[76815]: </domain>
Nov 14 22:10:27 user nova-compute[76815]:  {{(pid=76815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 22:10:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Successfully detached device tape02f16bb-de from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 from the persistent domain config.
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] (1/8): Attempting to detach device tape02f16bb-de with device alias net1 from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] detach device xml: <interface type="ethernet">
Nov 14 22:10:27 user nova-compute[76815]:   <mac address="fa:16:3e:47:9b:98"/>
Nov 14 22:10:27 user nova-compute[76815]:   <model type="virtio"/>
Nov 14 22:10:27 user nova-compute[76815]:   <mtu size="1442"/>
Nov 14 22:10:27 user nova-compute[76815]:   <target dev="tape02f16bb-de"/>
Nov 14 22:10:27 user nova-compute[76815]: </interface>
Nov 14 22:10:27 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Start waiting for the detach event from libvirt for device tape02f16bb-de with device alias net1 for instance 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 368050176 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-ab20a8ed-2829-4da7-8951-616162424cb5 req-1c901065-f88d-4139-b003-b1cc19f7df92 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-unplugged-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ab20a8ed-2829-4da7-8951-616162424cb5 req-1c901065-f88d-4139-b003-b1cc19f7df92 service nova] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ab20a8ed-2829-4da7-8951-616162424cb5 req-1c901065-f88d-4139-b003-b1cc19f7df92 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ab20a8ed-2829-4da7-8951-616162424cb5 req-1c901065-f88d-4139-b003-b1cc19f7df92 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-ab20a8ed-2829-4da7-8951-616162424cb5 req-1c901065-f88d-4139-b003-b1cc19f7df92 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] No waiting events found dispatching network-vif-unplugged-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:27 user nova-compute[76815]: WARNING nova.compute.manager [req-ab20a8ed-2829-4da7-8951-616162424cb5 req-1c901065-f88d-4139-b003-b1cc19f7df92 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received unexpected event network-vif-unplugged-e02f16bb-de13-4564-960f-d0c3991cff42 for instance with vm_state active and task_state None.
Nov 14 22:10:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:10:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 416284672 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 573571072 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 665845760 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 719323136 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-bae7831a-9228-4415-ab27-4cf68d9427b1 req-e01b1dbb-7a60-4467-8095-9c17ad0ec7f5 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-plugged-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bae7831a-9228-4415-ab27-4cf68d9427b1 req-e01b1dbb-7a60-4467-8095-9c17ad0ec7f5 service nova] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bae7831a-9228-4415-ab27-4cf68d9427b1 req-e01b1dbb-7a60-4467-8095-9c17ad0ec7f5 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bae7831a-9228-4415-ab27-4cf68d9427b1 req-e01b1dbb-7a60-4467-8095-9c17ad0ec7f5 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-bae7831a-9228-4415-ab27-4cf68d9427b1 req-e01b1dbb-7a60-4467-8095-9c17ad0ec7f5 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] No waiting events found dispatching network-vif-plugged-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:29 user nova-compute[76815]: WARNING nova.compute.manager [req-bae7831a-9228-4415-ab27-4cf68d9427b1 req-e01b1dbb-7a60-4467-8095-9c17ad0ec7f5 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received unexpected event network-vif-plugged-e02f16bb-de13-4564-960f-d0c3991cff42 for instance with vm_state active and task_state None.
Nov 14 22:10:29 user nova-compute[76815]: INFO nova.compute.manager [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] [instance: 38304882-101f-43c4-8c18-028c609924d3] Took 4.90 seconds to detach 3 volumes for instance.
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 851443712 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:30 user nova-compute[76815]: INFO nova.compute.manager [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] [instance: 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa] Took 4.51 seconds to detach 3 volumes for instance.
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 1009778688 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.672s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.229s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:30 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Deleted allocations for instance 38304882-101f-43c4-8c18-028c609924d3
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0d13d482-e200-4259-aad2-9dfd94a55e49 tempest-TaggedBootDevicesTest_v242-762042002 tempest-TaggedBootDevicesTest_v242-762042002-project-member] Lock "38304882-101f-43c4-8c18-028c609924d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.530s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgmAjBPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '77f0352b-63c8-4346-8d3c-d25826044d8b'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:31 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Deleted allocations for instance 13d9a6bb-bfe4-46b2-977b-4f38b746bbfa
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33e8cbd-865e-43c9-ae31-495fcde549e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:31 user nova-compute[76815]: No targets found.
Nov 14 22:10:31 user nova-compute[76815]: iSNS:
Nov 14 22:10:31 user nova-compute[76815]: No targets found.
Nov 14 22:10:31 user nova-compute[76815]: STATIC:
Nov 14 22:10:31 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:31 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:31 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:31 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:31 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:31 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:31 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a
Nov 14 22:10:31 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:31 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:31 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b
Nov 14 22:10:31 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:31 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:31 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:31 user nova-compute[76815]: No targets found.
Nov 14 22:10:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:31 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:31 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb3a6a4-02bb-4462-b9e7-626d2c0e9438]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-702e9701-cea1-4ada-b84f-0be89d4e4a94 tempest-TaggedBootDevicesTest-71226886 tempest-TaggedBootDevicesTest-71226886-project-member] Lock "13d9a6bb-bfe4-46b2-977b-4f38b746bbfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[080e9c4c-0996-477e-a246-b33153b29dd9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:31 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:31 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:31 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b (non-flash)
Nov 14 22:10:31 user nova-compute[76815]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:31 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:31 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74d9de0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b'): ({'sdj'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Removing single pathed devices sdj {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc6144f-5fe6-41d8-b52c-328bcac5bee4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e659933a-950a-4786-97d6-be203b973499]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Flushing IO for device /dev/sdj {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a41653-e5b3-4fd8-bafd-a49d1df220c9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71bf801-ba1c-4379-909f-659ff8541840]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] SCSI volumes sdj have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3affa4-fbae-4a32-8578-378ef8cf61b9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af90fe-9688-419c-bb82-f3a29912565a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b, portal: 172.16.0.220,3260]
Nov 14 22:10:31 user nova-compute[76815]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f0352b-63c8-4346-8d3c-d25826044d8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[116ebe2b-3fca-4b7d-98a2-1600492e7689]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] <== disconnect_volume: return (369ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqrJDINa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ab3b7495-76be-421d-9843-af965b815413', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5daf236-0fb0-4d09-9260-1ac52e92736a', 'serial'} {{(pid=76815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] swap_volume: removing Cinder connection for volume 77f0352b-63c8-4346-8d3c-d25826044d8b {{(pid=76815) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:10:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] [instance: ab3b7495-76be-421d-9843-af965b815413] swap_volume: Updating volume 77f0352b-63c8-4346-8d3c-d25826044d8b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "BqrJDINa", "auth_password": "5IEYxQXcC27GeA", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "d5daf236-0fb0-4d09-9260-1ac52e92736a"}, "status": "reserved", "instance": "ab3b7495-76be-421d-9843-af965b815413", "attached_at": "", "detached_at": "", "volume_id": "d5daf236-0fb0-4d09-9260-1ac52e92736a", "serial": "d5daf236-0fb0-4d09-9260-1ac52e92736a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd5daf236-0fb0-4d09-9260-1ac52e92736a', 'no_device': None, 'attachment_id': 'd8dd4834-83c1-4708-9e9c-a762f83085d7'} {{(pid=76815) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 22:10:33 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 is timed out.
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5b772371-41da-49c5-b63e-6ef520e037dc tempest-TestVolumeSwap-334516742 tempest-TestVolumeSwap-334516742-project-admin] Lock "ab3b7495-76be-421d-9843-af965b815413" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.408s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:33 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:10:33 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7451MB free_disk=25.416332244873047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Successfully detached device vdb from instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 from the live domain config.
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZwbucjQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:33 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a591a9c8-1c61-4174-b335-31794ff51f5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:33 user nova-compute[76815]: No targets found.
Nov 14 22:10:33 user nova-compute[76815]: iSNS:
Nov 14 22:10:33 user nova-compute[76815]: No targets found.
Nov 14 22:10:33 user nova-compute[76815]: STATIC:
Nov 14 22:10:33 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d
Nov 14 22:10:33 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:33 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:33 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:33 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:33 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:33 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a
Nov 14 22:10:33 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:33 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:33 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:33 user nova-compute[76815]: No targets found.
Nov 14 22:10:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:33 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:33 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01d2ef4-f880-4e0f-9eee-319cd509355d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[97331a9f-153d-4369-b504-2e57735a45e8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:33 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:33 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d (non-flash)
Nov 14 22:10:33 user nova-compute[76815]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:33 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4775360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d'): ({'sdm'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Removing single pathed devices sdm {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bb235db0-61d3-4e29-9794-b7c181f074d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 16c58923-c97e-4148-af31-9609b9af5d80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 91830a3a-8395-4f82-81c3-6aec79a46c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ab3b7495-76be-421d-9843-af965b815413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance adac433a-262e-49c1-b7c6-cc99dc88afa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc2111f-846b-4cb8-8555-7c3789b43830]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c46b2a-9507-4fc6-b122-7bfa9c1dbc42]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Flushing IO for device /dev/sdm {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0809d908-7645-43ff-acb6-8f924b00be0b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.055s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea1d213-d369-4291-b1a7-908dd42dccbe]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] SCSI volumes sdm have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabaafe8-0c31-49f2-99cc-18843973395f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a8239-8651-48b9-8200-2227262644d3]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d, portal: 172.16.0.220,3260]
Nov 14 22:10:33 user nova-compute[76815]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66727a2e-8873-464e-8e2e-1b465c19e84d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db43f72-2c7d-4bda-be89-a9e0479ad7bf]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] <== disconnect_volume: return (348ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:33 user nova-compute[76815]: INFO nova.compute.manager [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Detaching volume d5daf236-0fb0-4d09-9260-1ac52e92736a
Nov 14 22:10:33 user nova-compute[76815]: INFO nova.virt.block_device [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Attempting to driver detach volume d5daf236-0fb0-4d09-9260-1ac52e92736a from mountpoint /dev/vdb
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Attempting to detach device vdb from instance ab3b7495-76be-421d-9843-af965b815413 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:10:33 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:33 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:10:33 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:10:33 user nova-compute[76815]:   <serial>d5daf236-0fb0-4d09-9260-1ac52e92736a</serial>
Nov 14 22:10:33 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:10:33 user nova-compute[76815]: </disk>
Nov 14 22:10:33 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:10:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Successfully detached device vdb from instance ab3b7495-76be-421d-9843-af965b815413 from the persistent domain config.
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab3b7495-76be-421d-9843-af965b815413 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:10:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:10:33 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:10:33 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:10:33 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:10:33 user nova-compute[76815]:   <serial>d5daf236-0fb0-4d09-9260-1ac52e92736a</serial>
Nov 14 22:10:33 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:10:33 user nova-compute[76815]: </disk>
Nov 14 22:10:33 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:10:34 user nova-compute[76815]: DEBUG nova.objects.instance [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lazy-loading 'flavor' on Instance uuid fd038c28-ee30-4cbe-a0aa-518396ac9fc7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-127b892f-c8d6-4b14-8d11-3b8b239a864b tempest-VolumesAssistedSnapshotsTest-1256986796 tempest-VolumesAssistedSnapshotsTest-1256986796-project-admin] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab3b7495-76be-421d-9843-af965b815413 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Updating instance_info_cache with network_info: [{"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-a3ba0d7d-48dd-4718-9447-fb632bd1e57b" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:10:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:10:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "a4c05bc3-b996-4312-8276-a395c7802a1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:10:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:10:44 user nova-compute[76815]: INFO nova.compute.claims [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Claim successful on node user
Nov 14 22:10:45 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:10:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:10:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG nova.policy [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '187becfe77604b6d9b4d7f2e8826631d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acd89e0ce8ea4637b1f83034d9264bf6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:10:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Creating image(s)
Nov 14 22:10:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "/opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "/opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk 1073741824" returned: 0 in 0.047s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Successfully created port: 3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Cannot resize image /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Ensure instance console log exists: /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Successfully updated port: 3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "refresh_cache-a4c05bc3-b996-4312-8276-a395c7802a1c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquired lock "refresh_cache-a4c05bc3-b996-4312-8276-a395c7802a1c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-0d57b805-e441-49f8-b996-58fc2f1eb099 req-fbac2e4f-41e5-4d60-a580-02f8df19a8d5 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received event network-changed-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-0d57b805-e441-49f8-b996-58fc2f1eb099 req-fbac2e4f-41e5-4d60-a580-02f8df19a8d5 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Refreshing instance network info cache due to event network-changed-3f031d08-6ef5-4e41-b799-162aad3aa986. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0d57b805-e441-49f8-b996-58fc2f1eb099 req-fbac2e4f-41e5-4d60-a580-02f8df19a8d5 service nova] Acquiring lock "refresh_cache-a4c05bc3-b996-4312-8276-a395c7802a1c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:10:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Updating instance_info_cache with network_info: [{"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Releasing lock "refresh_cache-a4c05bc3-b996-4312-8276-a395c7802a1c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Instance network_info: |[{"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0d57b805-e441-49f8-b996-58fc2f1eb099 req-fbac2e4f-41e5-4d60-a580-02f8df19a8d5 service nova] Acquired lock "refresh_cache-a4c05bc3-b996-4312-8276-a395c7802a1c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.neutron [req-0d57b805-e441-49f8-b996-58fc2f1eb099 req-fbac2e4f-41e5-4d60-a580-02f8df19a8d5 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Refreshing network info cache for port 3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Start _get_guest_xml network_info=[{"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:10:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:10:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-818944814',display_name='tempest-VolumesAdminNegativeTest-server-818944814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-818944814',id=13,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acd89e0ce8ea4637b1f83034d9264bf6',ramdisk_id='',reservation_id='r-tgasajq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77219795',owner_user_name='tempest-VolumesAdminNegativeTest-77219795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:10:46Z,user_data=None,user_id='187becfe77604b6d9b4d7f2e8826631d',uuid=a4c05bc3-b996-4312-8276-a395c7802a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converting VIF {"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:2d:8c,bridge_name='br-int',has_traffic_filtering=True,id=3f031d08-6ef5-4e41-b799-162aad3aa986,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f031d08-6e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.objects.instance [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lazy-loading 'pci_devices' on Instance uuid a4c05bc3-b996-4312-8276-a395c7802a1c {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:10:47 user nova-compute[76815]:   <uuid>a4c05bc3-b996-4312-8276-a395c7802a1c</uuid>
Nov 14 22:10:47 user nova-compute[76815]:   <name>instance-0000000d</name>
Nov 14 22:10:47 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:10:47 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:10:47 user nova-compute[76815]:   <metadata>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:10:47 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:10:47 user nova-compute[76815]:       <nova:name>tempest-VolumesAdminNegativeTest-server-818944814</nova:name>
Nov 14 22:10:47 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:10:47</nova:creationTime>
Nov 14 22:10:47 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:10:47 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:10:47 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:10:47 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:10:47 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:10:47 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:10:47 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:10:47 user nova-compute[76815]:       <nova:owner>
Nov 14 22:10:47 user nova-compute[76815]:         <nova:user uuid="187becfe77604b6d9b4d7f2e8826631d">tempest-VolumesAdminNegativeTest-77219795-project-member</nova:user>
Nov 14 22:10:47 user nova-compute[76815]:         <nova:project uuid="acd89e0ce8ea4637b1f83034d9264bf6">tempest-VolumesAdminNegativeTest-77219795</nova:project>
Nov 14 22:10:47 user nova-compute[76815]:       </nova:owner>
Nov 14 22:10:47 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:10:47 user nova-compute[76815]:       <nova:ports>
Nov 14 22:10:47 user nova-compute[76815]:         <nova:port uuid="3f031d08-6ef5-4e41-b799-162aad3aa986">
Nov 14 22:10:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 22:10:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:10:47 user nova-compute[76815]:       </nova:ports>
Nov 14 22:10:47 user nova-compute[76815]:     </nova:instance>
Nov 14 22:10:47 user nova-compute[76815]:   </metadata>
Nov 14 22:10:47 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:10:47 user nova-compute[76815]:     <system>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name="serial">a4c05bc3-b996-4312-8276-a395c7802a1c</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name="uuid">a4c05bc3-b996-4312-8276-a395c7802a1c</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:10:47 user nova-compute[76815]:     </system>
Nov 14 22:10:47 user nova-compute[76815]:   </sysinfo>
Nov 14 22:10:47 user nova-compute[76815]:   <os>
Nov 14 22:10:47 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:10:47 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:10:47 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:10:47 user nova-compute[76815]:   </os>
Nov 14 22:10:47 user nova-compute[76815]:   <features>
Nov 14 22:10:47 user nova-compute[76815]:     <acpi/>
Nov 14 22:10:47 user nova-compute[76815]:     <apic/>
Nov 14 22:10:47 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:10:47 user nova-compute[76815]:   </features>
Nov 14 22:10:47 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:10:47 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:10:47 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:10:47 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:10:47 user nova-compute[76815]:   </clock>
Nov 14 22:10:47 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:10:47 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:10:47 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:10:47 user nova-compute[76815]:   </cpu>
Nov 14 22:10:47 user nova-compute[76815]:   <devices>
Nov 14 22:10:47 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:10:47 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:10:47 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk"/>
Nov 14 22:10:47 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:10:47 user nova-compute[76815]:     </disk>
Nov 14 22:10:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:10:47 user nova-compute[76815]:       <mac address="fa:16:3e:57:2d:8c"/>
Nov 14 22:10:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:10:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:10:47 user nova-compute[76815]:       <target dev="tap3f031d08-6e"/>
Nov 14 22:10:47 user nova-compute[76815]:     </interface>
Nov 14 22:10:47 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:10:47 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/console.log" append="off"/>
Nov 14 22:10:47 user nova-compute[76815]:     </serial>
Nov 14 22:10:47 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:10:47 user nova-compute[76815]:     <video>
Nov 14 22:10:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:10:47 user nova-compute[76815]:     </video>
Nov 14 22:10:47 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:10:47 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:10:47 user nova-compute[76815]:     </rng>
Nov 14 22:10:47 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:10:47 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:10:47 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:10:47 user nova-compute[76815]:     </memballoon>
Nov 14 22:10:47 user nova-compute[76815]:   </devices>
Nov 14 22:10:47 user nova-compute[76815]: </domain>
Nov 14 22:10:47 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-818944814',display_name='tempest-VolumesAdminNegativeTest-server-818944814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-818944814',id=13,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acd89e0ce8ea4637b1f83034d9264bf6',ramdisk_id='',reservation_id='r-tgasajq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-77219795',owner_user_name='tempest-VolumesAdminNegativeTest-77219795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:10:46Z,user_data=None,user_id='187becfe77604b6d9b4d7f2e8826631d',uuid=a4c05bc3-b996-4312-8276-a395c7802a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converting VIF {"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:2d:8c,bridge_name='br-int',has_traffic_filtering=True,id=3f031d08-6ef5-4e41-b799-162aad3aa986,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f031d08-6e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG os_vif [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:2d:8c,bridge_name='br-int',has_traffic_filtering=True,id=3f031d08-6ef5-4e41-b799-162aad3aa986,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f031d08-6e') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b02fd50-e7f5-5a85-857f-76e1ef9a99e8', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f031d08-6e, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f031d08-6e, col_values=(('qos', UUID('765d7434-2be0-4a2d-9ecf-bd2f8f19a21c')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f031d08-6e, col_values=(('external_ids', {'iface-id': '3f031d08-6ef5-4e41-b799-162aad3aa986', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:2d:8c', 'vm-uuid': 'a4c05bc3-b996-4312-8276-a395c7802a1c'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: INFO os_vif [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:2d:8c,bridge_name='br-int',has_traffic_filtering=True,id=3f031d08-6ef5-4e41-b799-162aad3aa986,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f031d08-6e')
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] No VIF found with MAC fa:16:3e:57:2d:8c, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.neutron [req-0d57b805-e441-49f8-b996-58fc2f1eb099 req-fbac2e4f-41e5-4d60-a580-02f8df19a8d5 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Updated VIF entry in instance network info cache for port 3f031d08-6ef5-4e41-b799-162aad3aa986. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.neutron [req-0d57b805-e441-49f8-b996-58fc2f1eb099 req-fbac2e4f-41e5-4d60-a580-02f8df19a8d5 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Updating instance_info_cache with network_info: [{"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0d57b805-e441-49f8-b996-58fc2f1eb099 req-fbac2e4f-41e5-4d60-a580-02f8df19a8d5 service nova] Releasing lock "refresh_cache-a4c05bc3-b996-4312-8276-a395c7802a1c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:10:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Waiting for libvirt event about the detach of device tape02f16bb-de with device alias net1 from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 is timed out.
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:9b:98"/><model type="virtio"/><mtu size="1442"/><target dev="tape02f16bb-de"/></interface> {{(pid=76815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:9b:98"/><model type="virtio"/><mtu size="1442"/><target dev="tape02f16bb-de"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 14 22:10:47 user nova-compute[76815]:   <name>instance-00000006</name>
Nov 14 22:10:47 user nova-compute[76815]:   <uuid>91830a3a-8395-4f82-81c3-6aec79a46c33</uuid>
Nov 14 22:10:47 user nova-compute[76815]:   <metadata>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:10:47 user nova-compute[76815]:   <nova:package version="0.0.0"/>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:name>tempest-device-tagging-server-239797802</nova:name>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:creationTime>2023-11-14 22:09:54</nova:creationTime>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:flavor name="m1.tiny">
Nov 14 22:10:47 user nova-compute[76815]:     <nova:memory>512</nova:memory>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:disk>1</nova:disk>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:swap>0</nova:swap>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:vcpus>1</nova:vcpus>
Nov 14 22:10:47 user nova-compute[76815]:   </nova:flavor>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:owner>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:user uuid="3356e497cd5243beb1e6d5aa0b24a177">tempest-TaggedAttachmentsTest-1610929038-project-member</nova:user>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:project uuid="3f304c47366c4cd1af23a1f0d43d8825">tempest-TaggedAttachmentsTest-1610929038</nova:project>
Nov 14 22:10:47 user nova-compute[76815]:   </nova:owner>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:ports>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:port uuid="5688ed4c-da6e-445f-9839-2d49c9724bc8">
Nov 14 22:10:47 user nova-compute[76815]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:10:47 user nova-compute[76815]:     </nova:port>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:port uuid="e02f16bb-de13-4564-960f-d0c3991cff42">
Nov 14 22:10:47 user nova-compute[76815]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Nov 14 22:10:47 user nova-compute[76815]:     </nova:port>
Nov 14 22:10:47 user nova-compute[76815]:   </nova:ports>
Nov 14 22:10:47 user nova-compute[76815]: </nova:instance>
Nov 14 22:10:47 user nova-compute[76815]:   </metadata>
Nov 14 22:10:47 user nova-compute[76815]:   <memory unit='KiB'>524288</memory>
Nov 14 22:10:47 user nova-compute[76815]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 22:10:47 user nova-compute[76815]:   <vcpu placement='static'>1</vcpu>
Nov 14 22:10:47 user nova-compute[76815]:   <resource>
Nov 14 22:10:47 user nova-compute[76815]:     <partition>/machine</partition>
Nov 14 22:10:47 user nova-compute[76815]:   </resource>
Nov 14 22:10:47 user nova-compute[76815]:   <sysinfo type='smbios'>
Nov 14 22:10:47 user nova-compute[76815]:     <system>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name='version'>0.0.0</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name='serial'>91830a3a-8395-4f82-81c3-6aec79a46c33</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name='uuid'>91830a3a-8395-4f82-81c3-6aec79a46c33</entry>
Nov 14 22:10:47 user nova-compute[76815]:       <entry name='family'>Virtual Machine</entry>
Nov 14 22:10:47 user nova-compute[76815]:     </system>
Nov 14 22:10:47 user nova-compute[76815]:   </sysinfo>
Nov 14 22:10:47 user nova-compute[76815]:   <os>
Nov 14 22:10:47 user nova-compute[76815]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 22:10:47 user nova-compute[76815]:     <boot dev='hd'/>
Nov 14 22:10:47 user nova-compute[76815]:     <smbios mode='sysinfo'/>
Nov 14 22:10:47 user nova-compute[76815]:   </os>
Nov 14 22:10:47 user nova-compute[76815]:   <features>
Nov 14 22:10:47 user nova-compute[76815]:     <acpi/>
Nov 14 22:10:47 user nova-compute[76815]:     <apic/>
Nov 14 22:10:47 user nova-compute[76815]:     <vmcoreinfo state='on'/>
Nov 14 22:10:47 user nova-compute[76815]:   </features>
Nov 14 22:10:47 user nova-compute[76815]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 22:10:47 user nova-compute[76815]:     <model fallback='forbid'>Nehalem</model>
Nov 14 22:10:47 user nova-compute[76815]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 22:10:47 user nova-compute[76815]:     <feature policy='require' name='vme'/>
Nov 14 22:10:47 user nova-compute[76815]:     <feature policy='require' name='x2apic'/>
Nov 14 22:10:47 user nova-compute[76815]:     <feature policy='require' name='hypervisor'/>
Nov 14 22:10:47 user nova-compute[76815]:   </cpu>
Nov 14 22:10:47 user nova-compute[76815]:   <clock offset='utc'>
Nov 14 22:10:47 user nova-compute[76815]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 22:10:47 user nova-compute[76815]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 22:10:47 user nova-compute[76815]:     <timer name='hpet' present='no'/>
Nov 14 22:10:47 user nova-compute[76815]:   </clock>
Nov 14 22:10:47 user nova-compute[76815]:   <on_poweroff>destroy</on_poweroff>
Nov 14 22:10:47 user nova-compute[76815]:   <on_reboot>restart</on_reboot>
Nov 14 22:10:47 user nova-compute[76815]:   <on_crash>destroy</on_crash>
Nov 14 22:10:47 user nova-compute[76815]:   <devices>
Nov 14 22:10:47 user nova-compute[76815]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 22:10:47 user nova-compute[76815]:     <disk type='file' device='disk'>
Nov 14 22:10:47 user nova-compute[76815]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 22:10:47 user nova-compute[76815]:       <source file='/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk' index='2'/>
Nov 14 22:10:47 user nova-compute[76815]:       <backingStore type='file' index='3'>
Nov 14 22:10:47 user nova-compute[76815]:         <format type='raw'/>
Nov 14 22:10:47 user nova-compute[76815]:         <source file='/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b'/>
Nov 14 22:10:47 user nova-compute[76815]:         <backingStore/>
Nov 14 22:10:47 user nova-compute[76815]:       </backingStore>
Nov 14 22:10:47 user nova-compute[76815]:       <target dev='vda' bus='virtio'/>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='virtio-disk0'/>
Nov 14 22:10:47 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </disk>
Nov 14 22:10:47 user nova-compute[76815]:     <disk type='file' device='cdrom'>
Nov 14 22:10:47 user nova-compute[76815]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 22:10:47 user nova-compute[76815]:       <source file='/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/disk.config' index='1'/>
Nov 14 22:10:47 user nova-compute[76815]:       <backingStore/>
Nov 14 22:10:47 user nova-compute[76815]:       <target dev='hda' bus='ide'/>
Nov 14 22:10:47 user nova-compute[76815]:       <readonly/>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='ide0-0-0'/>
Nov 14 22:10:47 user nova-compute[76815]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </disk>
Nov 14 22:10:47 user nova-compute[76815]:     <controller type='usb' index='0' model='none'>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='usb'/>
Nov 14 22:10:47 user nova-compute[76815]:     </controller>
Nov 14 22:10:47 user nova-compute[76815]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='pci.0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </controller>
Nov 14 22:10:47 user nova-compute[76815]:     <controller type='ide' index='0'>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='ide'/>
Nov 14 22:10:47 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 22:10:47 user nova-compute[76815]:     </controller>
Nov 14 22:10:47 user nova-compute[76815]:     <interface type='ethernet'>
Nov 14 22:10:47 user nova-compute[76815]:       <mac address='fa:16:3e:21:d0:50'/>
Nov 14 22:10:47 user nova-compute[76815]:       <target dev='tap5688ed4c-da'/>
Nov 14 22:10:47 user nova-compute[76815]:       <model type='virtio'/>
Nov 14 22:10:47 user nova-compute[76815]:       <mtu size='1442'/>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='net0'/>
Nov 14 22:10:47 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </interface>
Nov 14 22:10:47 user nova-compute[76815]:     <serial type='pty'>
Nov 14 22:10:47 user nova-compute[76815]:       <source path='/dev/pts/4'/>
Nov 14 22:10:47 user nova-compute[76815]:       <log file='/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/console.log' append='off'/>
Nov 14 22:10:47 user nova-compute[76815]:       <target type='isa-serial' port='0'>
Nov 14 22:10:47 user nova-compute[76815]:         <model name='isa-serial'/>
Nov 14 22:10:47 user nova-compute[76815]:       </target>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='serial0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </serial>
Nov 14 22:10:47 user nova-compute[76815]:     <console type='pty' tty='/dev/pts/4'>
Nov 14 22:10:47 user nova-compute[76815]:       <source path='/dev/pts/4'/>
Nov 14 22:10:47 user nova-compute[76815]:       <log file='/opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33/console.log' append='off'/>
Nov 14 22:10:47 user nova-compute[76815]:       <target type='serial' port='0'/>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='serial0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </console>
Nov 14 22:10:47 user nova-compute[76815]:     <input type='mouse' bus='ps2'>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='input0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </input>
Nov 14 22:10:47 user nova-compute[76815]:     <input type='keyboard' bus='ps2'>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='input1'/>
Nov 14 22:10:47 user nova-compute[76815]:     </input>
Nov 14 22:10:47 user nova-compute[76815]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 14 22:10:47 user nova-compute[76815]:       <listen type='address' address='0.0.0.0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </graphics>
Nov 14 22:10:47 user nova-compute[76815]:     <audio id='1' type='none'/>
Nov 14 22:10:47 user nova-compute[76815]:     <video>
Nov 14 22:10:47 user nova-compute[76815]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='video0'/>
Nov 14 22:10:47 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </video>
Nov 14 22:10:47 user nova-compute[76815]:     <memballoon model='virtio'>
Nov 14 22:10:47 user nova-compute[76815]:       <stats period='10'/>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='balloon0'/>
Nov 14 22:10:47 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </memballoon>
Nov 14 22:10:47 user nova-compute[76815]:     <rng model='virtio'>
Nov 14 22:10:47 user nova-compute[76815]:       <backend model='random'>/dev/urandom</backend>
Nov 14 22:10:47 user nova-compute[76815]:       <alias name='rng0'/>
Nov 14 22:10:47 user nova-compute[76815]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 22:10:47 user nova-compute[76815]:     </rng>
Nov 14 22:10:47 user nova-compute[76815]:   </devices>
Nov 14 22:10:47 user nova-compute[76815]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 22:10:47 user nova-compute[76815]:     <label>libvirt-91830a3a-8395-4f82-81c3-6aec79a46c33</label>
Nov 14 22:10:47 user nova-compute[76815]:     <imagelabel>libvirt-91830a3a-8395-4f82-81c3-6aec79a46c33</imagelabel>
Nov 14 22:10:47 user nova-compute[76815]:   </seclabel>
Nov 14 22:10:47 user nova-compute[76815]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 22:10:47 user nova-compute[76815]:     <label>+64055:+108</label>
Nov 14 22:10:47 user nova-compute[76815]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 22:10:47 user nova-compute[76815]:   </seclabel>
Nov 14 22:10:47 user nova-compute[76815]: </domain>
Nov 14 22:10:47 user nova-compute[76815]:  {{(pid=76815) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 22:10:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Successfully detached device tape02f16bb-de from instance 91830a3a-8395-4f82-81c3-6aec79a46c33 from the live domain config.
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239797802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239797802',id=6,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp1I2ExuD5M3u6m5DSKi2h8Sbi9eJkAW82TUikZkZ6/CmyHFgzEt+tH3XphSvsi+i6IpnxEg23xGXTPTV8VZcAvDG1z9g4zldZJtkz5P+3Huuf8Uxsjfoa/XNo/Ex9vg==',key_name='tempest-keypair-1648996082',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f304c47366c4cd1af23a1f0d43d8825',ramdisk_id='',reservation_id='r-m3vhi65s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1610929038',owner_user_name='tempest-TaggedAttachmentsTest-1610929038-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3356e497cd5243beb1e6d5aa0b24a177',uuid=91830a3a-8395-4f82-81c3-6aec79a46c33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converting VIF {"id": "e02f16bb-de13-4564-960f-d0c3991cff42", "address": "fa:16:3e:47:9b:98", "network": {"id": "ab9efc23-9077-40ac-ab20-e2d565885001", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-322499572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02f16bb-de", "ovs_interfaceid": "e02f16bb-de13-4564-960f-d0c3991cff42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:98,bridge_name='br-int',has_traffic_filtering=True,id=e02f16bb-de13-4564-960f-d0c3991cff42,network=Network(ab9efc23-9077-40ac-ab20-e2d565885001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02f16bb-de') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG os_vif [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:98,bridge_name='br-int',has_traffic_filtering=True,id=e02f16bb-de13-4564-960f-d0c3991cff42,network=Network(ab9efc23-9077-40ac-ab20-e2d565885001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02f16bb-de') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape02f16bb-de, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7474d7fd-e44b-43f4-b93a-34aadfbad946) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:47 user nova-compute[76815]: INFO os_vif [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:9b:98,bridge_name='br-int',has_traffic_filtering=True,id=e02f16bb-de13-4564-960f-d0c3991cff42,network=Network(ab9efc23-9077-40ac-ab20-e2d565885001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02f16bb-de')
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:10:47 user nova-compute[76815]:   <nova:package version="0.0.0"/>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:name>tempest-device-tagging-server-239797802</nova:name>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:creationTime>2023-11-14 22:10:47</nova:creationTime>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:flavor name="m1.tiny">
Nov 14 22:10:47 user nova-compute[76815]:     <nova:memory>512</nova:memory>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:disk>1</nova:disk>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:swap>0</nova:swap>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:vcpus>1</nova:vcpus>
Nov 14 22:10:47 user nova-compute[76815]:   </nova:flavor>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:owner>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:user uuid="3356e497cd5243beb1e6d5aa0b24a177">tempest-TaggedAttachmentsTest-1610929038-project-member</nova:user>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:project uuid="3f304c47366c4cd1af23a1f0d43d8825">tempest-TaggedAttachmentsTest-1610929038</nova:project>
Nov 14 22:10:47 user nova-compute[76815]:   </nova:owner>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:10:47 user nova-compute[76815]:   <nova:ports>
Nov 14 22:10:47 user nova-compute[76815]:     <nova:port uuid="5688ed4c-da6e-445f-9839-2d49c9724bc8">
Nov 14 22:10:47 user nova-compute[76815]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:10:47 user nova-compute[76815]:     </nova:port>
Nov 14 22:10:47 user nova-compute[76815]:   </nova:ports>
Nov 14 22:10:47 user nova-compute[76815]: </nova:instance>
Nov 14 22:10:47 user nova-compute[76815]:  {{(pid=76815) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquired lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:10:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:10:48 user nova-compute[76815]: INFO nova.network.neutron [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Port e02f16bb-de13-4564-960f-d0c3991cff42 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 14 22:10:48 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updating instance_info_cache with network_info: [{"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Releasing lock "refresh_cache-91830a3a-8395-4f82-81c3-6aec79a46c33" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ad1e06ac-3424-4c24-ac57-b22dd859a7cc tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "interface-91830a3a-8395-4f82-81c3-6aec79a46c33-e02f16bb-de13-4564-960f-d0c3991cff42" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.367s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-7a61c878-87f4-411f-8155-b4213c927f2f req-906e80e7-3f0f-4096-806a-18bec73ee476 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received event network-vif-plugged-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7a61c878-87f4-411f-8155-b4213c927f2f req-906e80e7-3f0f-4096-806a-18bec73ee476 service nova] Acquiring lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7a61c878-87f4-411f-8155-b4213c927f2f req-906e80e7-3f0f-4096-806a-18bec73ee476 service nova] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7a61c878-87f4-411f-8155-b4213c927f2f req-906e80e7-3f0f-4096-806a-18bec73ee476 service nova] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-7a61c878-87f4-411f-8155-b4213c927f2f req-906e80e7-3f0f-4096-806a-18bec73ee476 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] No waiting events found dispatching network-vif-plugged-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:48 user nova-compute[76815]: WARNING nova.compute.manager [req-7a61c878-87f4-411f-8155-b4213c927f2f req-906e80e7-3f0f-4096-806a-18bec73ee476 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received unexpected event network-vif-plugged-3f031d08-6ef5-4e41-b799-162aad3aa986 for instance with vm_state building and task_state spawning.
Nov 14 22:10:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d71b6d5f-9632-4c3c-83c3-293fa21c6914 req-e5f6a3ca-41d6-4ee4-9967-daf2fb03131b service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-deleted-e02f16bb-de13-4564-960f-d0c3991cff42 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:10:50 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Instance spawned successfully.
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:10:50 user nova-compute[76815]: INFO nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-d8d2338f-dfd9-410d-9580-cc1bebce4a26 req-a5c4c9cd-81c0-4656-b463-ccfc3d89adfd service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received event network-vif-plugged-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d8d2338f-dfd9-410d-9580-cc1bebce4a26 req-a5c4c9cd-81c0-4656-b463-ccfc3d89adfd service nova] Acquiring lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d8d2338f-dfd9-410d-9580-cc1bebce4a26 req-a5c4c9cd-81c0-4656-b463-ccfc3d89adfd service nova] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d8d2338f-dfd9-410d-9580-cc1bebce4a26 req-a5c4c9cd-81c0-4656-b463-ccfc3d89adfd service nova] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-d8d2338f-dfd9-410d-9580-cc1bebce4a26 req-a5c4c9cd-81c0-4656-b463-ccfc3d89adfd service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] No waiting events found dispatching network-vif-plugged-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:10:50 user nova-compute[76815]: WARNING nova.compute.manager [req-d8d2338f-dfd9-410d-9580-cc1bebce4a26 req-a5c4c9cd-81c0-4656-b463-ccfc3d89adfd service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received unexpected event network-vif-plugged-3f031d08-6ef5-4e41-b799-162aad3aa986 for instance with vm_state building and task_state spawning.
Nov 14 22:10:50 user nova-compute[76815]: INFO nova.compute.manager [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Took 5.95 seconds to build instance.
Nov 14 22:10:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9e3b657-4253-4e9c-a3c6-40792eff8db1 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.040s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:54 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ab3b7495-76be-421d-9843-af965b815413 is timed out.
Nov 14 22:10:54 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Successfully detached device vdb from instance ab3b7495-76be-421d-9843-af965b815413 from the live domain config.
Nov 14 22:10:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BqrJDINa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'd5daf236-0fb0-4d09-9260-1ac52e92736a'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:10:54 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6173cb66-b800-4661-8f35-8b89293aa7d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:10:54 user nova-compute[76815]: No targets found.
Nov 14 22:10:54 user nova-compute[76815]: iSNS:
Nov 14 22:10:54 user nova-compute[76815]: No targets found.
Nov 14 22:10:54 user nova-compute[76815]: STATIC:
Nov 14 22:10:54 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:10:54 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:54 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:54 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a
Nov 14 22:10:54 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:10:54 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:10:54 user nova-compute[76815]: FIRMWARE:
Nov 14 22:10:54 user nova-compute[76815]: No targets found.
Nov 14 22:10:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:10:54 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:10:54 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328ab64-0f22-487d-a41b-9e5dd43e3320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee87f382-bc82-49c8-886c-2fc4d37034b9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:54 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:10:54 user nova-compute[76815]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a (non-flash)
Nov 14 22:10:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a47751b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8977573f-c6eb-4db6-aca8-8fd97d126270]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eebd9ae-78fb-482a-a66d-98ab19a458b4]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5b557-557b-4bab-8823-fd6b2f3191c2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[925294e9-6beb-4c46-adf2-65c6001d79e2]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[652d53ff-4010-4973-a143-aa19711dbd7e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ee7036-ef5c-4a17-b134-6ee816e79d51]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260]
Nov 14 22:10:54 user nova-compute[76815]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a, portal: 172.16.0.220,3260] successful.
Nov 14 22:10:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5daf236-0fb0-4d09-9260-1ac52e92736a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e2638-a161-406f-ba06-aaf70072e88d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] <== disconnect_volume: return (281ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:10:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:10:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lazy-loading 'flavor' on Instance uuid ab3b7495-76be-421d-9843-af965b815413 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:10:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3febd376-7763-476f-a226-328df6430b94 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.695s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:10:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:10:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:11:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:11:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:11:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:05 user nova-compute[76815]: INFO nova.compute.manager [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Terminating instance
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-c9989950-475c-40af-81ad-c77c8ba8b087 req-fb601598-8d29-4096-b782-d4c6f2ac00ad service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received event network-vif-unplugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c9989950-475c-40af-81ad-c77c8ba8b087 req-fb601598-8d29-4096-b782-d4c6f2ac00ad service nova] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c9989950-475c-40af-81ad-c77c8ba8b087 req-fb601598-8d29-4096-b782-d4c6f2ac00ad service nova] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c9989950-475c-40af-81ad-c77c8ba8b087 req-fb601598-8d29-4096-b782-d4c6f2ac00ad service nova] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-c9989950-475c-40af-81ad-c77c8ba8b087 req-fb601598-8d29-4096-b782-d4c6f2ac00ad service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] No waiting events found dispatching network-vif-unplugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-c9989950-475c-40af-81ad-c77c8ba8b087 req-fb601598-8d29-4096-b782-d4c6f2ac00ad service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received event network-vif-unplugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:11:05 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Instance destroyed successfully.
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.objects.instance [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lazy-loading 'resources' on Instance uuid fd038c28-ee30-4cbe-a0aa-518396ac9fc7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1037971562',display_name='tempest-VolumesAssistedSnapshotsTest-server-1037971562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1037971562',id=8,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUO7iX3RDRULy/pFghpVkS2onmYTPk+weXeCOCyAJUtnLUTo5F0kuNkQJpQP3hL/UFam/wbF0kHpP+rLyAy7eg2mARAWCzvG766udico0PjTKJqRlcJMLuCUaPPhEj7Rg==',key_name='tempest-keypair-186302895',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a1e36264b084350965e57944e11f950',ramdisk_id='',reservation_id='r-5qtfnn2g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-310688643',owner_user_name='tempest-VolumesAssistedSnapshotsTest-310688643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e4c449a38e544cc994bd98914310b36',uuid=fd038c28-ee30-4cbe-a0aa-518396ac9fc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Converting VIF {"id": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "address": "fa:16:3e:fb:2d:b5", "network": {"id": "d3e452a3-6a79-47e4-b9e9-4cecd0cae866", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-373648294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1e36264b084350965e57944e11f950", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3e12eb-00", "ovs_interfaceid": "2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41,network=Network(d3e452a3-6a79-47e4-b9e9-4cecd0cae866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3e12eb-00') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG os_vif [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41,network=Network(d3e452a3-6a79-47e4-b9e9-4cecd0cae866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3e12eb-00') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b3e12eb-00, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c7da674-134a-4415-9a73-85f59fba7894) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:05 user nova-compute[76815]: INFO os_vif [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:2d:b5,bridge_name='br-int',has_traffic_filtering=True,id=2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41,network=Network(d3e452a3-6a79-47e4-b9e9-4cecd0cae866),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3e12eb-00')
Nov 14 22:11:05 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Deleting instance files /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7_del
Nov 14 22:11:05 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Deletion of /opt/stack/data/nova/instances/fd038c28-ee30-4cbe-a0aa-518396ac9fc7_del complete
Nov 14 22:11:05 user nova-compute[76815]: INFO nova.compute.manager [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 22:11:05 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:11:05 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:11:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:06 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:06 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Took 0.92 seconds to deallocate network for instance.
Nov 14 22:11:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-6f53f511-5648-45de-92a7-efd7aa46198e req-578aaca9-9e7c-4642-a968-698c6905625f service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received event network-vif-deleted-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:06 user nova-compute[76815]: INFO nova.compute.manager [req-6f53f511-5648-45de-92a7-efd7aa46198e req-578aaca9-9e7c-4642-a968-698c6905625f service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Neutron deleted interface 2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41; detaching it from the instance and deleting it from the info cache
Nov 14 22:11:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-6f53f511-5648-45de-92a7-efd7aa46198e req-578aaca9-9e7c-4642-a968-698c6905625f service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-6f53f511-5648-45de-92a7-efd7aa46198e req-578aaca9-9e7c-4642-a968-698c6905625f service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Detach interface failed, port_id=2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41, reason: Instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:11:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:07 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:07 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:07 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Deleted allocations for instance fd038c28-ee30-4cbe-a0aa-518396ac9fc7
Nov 14 22:11:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-878782e3-4c4f-4a94-9a52-af14d39772a3 req-73473e37-7fcd-4517-a9e6-cdae740fd409 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received event network-vif-plugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-878782e3-4c4f-4a94-9a52-af14d39772a3 req-73473e37-7fcd-4517-a9e6-cdae740fd409 service nova] Acquiring lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-878782e3-4c4f-4a94-9a52-af14d39772a3 req-73473e37-7fcd-4517-a9e6-cdae740fd409 service nova] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-878782e3-4c4f-4a94-9a52-af14d39772a3 req-73473e37-7fcd-4517-a9e6-cdae740fd409 service nova] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-878782e3-4c4f-4a94-9a52-af14d39772a3 req-73473e37-7fcd-4517-a9e6-cdae740fd409 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] No waiting events found dispatching network-vif-plugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:07 user nova-compute[76815]: WARNING nova.compute.manager [req-878782e3-4c4f-4a94-9a52-af14d39772a3 req-73473e37-7fcd-4517-a9e6-cdae740fd409 service nova] [instance: fd038c28-ee30-4cbe-a0aa-518396ac9fc7] Received unexpected event network-vif-plugged-2b3e12eb-00ef-4182-8f8a-a2e94ea5ff41 for instance with vm_state deleted and task_state None.
Nov 14 22:11:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9131aba2-5a45-4a2c-92fb-02328413438b tempest-VolumesAssistedSnapshotsTest-310688643 tempest-VolumesAssistedSnapshotsTest-310688643-project-member] Lock "fd038c28-ee30-4cbe-a0aa-518396ac9fc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.392s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:10 user nova-compute[76815]: INFO nova.compute.manager [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Terminating instance
Nov 14 22:11:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-b81dc63a-9ae4-41fd-84ca-47e113f9d0ac req-2abca7f9-14af-4fd0-a840-9e98feb6aec2 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received event network-vif-unplugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b81dc63a-9ae4-41fd-84ca-47e113f9d0ac req-2abca7f9-14af-4fd0-a840-9e98feb6aec2 service nova] Acquiring lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b81dc63a-9ae4-41fd-84ca-47e113f9d0ac req-2abca7f9-14af-4fd0-a840-9e98feb6aec2 service nova] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b81dc63a-9ae4-41fd-84ca-47e113f9d0ac req-2abca7f9-14af-4fd0-a840-9e98feb6aec2 service nova] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-b81dc63a-9ae4-41fd-84ca-47e113f9d0ac req-2abca7f9-14af-4fd0-a840-9e98feb6aec2 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] No waiting events found dispatching network-vif-unplugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-b81dc63a-9ae4-41fd-84ca-47e113f9d0ac req-2abca7f9-14af-4fd0-a840-9e98feb6aec2 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received event network-vif-unplugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Instance destroyed successfully.
Nov 14 22:11:11 user nova-compute[76815]: DEBUG nova.objects.instance [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lazy-loading 'resources' on Instance uuid 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:09:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-25609801',display_name='tempest-VolumesActionsTest-instance-25609801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-25609801',id=11,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:09:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9c9996c7ec44bdf912e9dfc6cd852a0',ramdisk_id='',reservation_id='r-g0zk0rcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-439034333',owner_user_name='tempest-VolumesActionsTest-439034333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:09:26Z,user_data=None,user_id='4b7935d9b21649d6a22c6b8700fbee4f',uuid=4f27c15c-c2d3-4a4c-af05-3a91b4fe3033,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converting VIF {"id": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "address": "fa:16:3e:2f:e9:f6", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6d1ceb1-c8", "ovs_interfaceid": "b6d1ceb1-c884-47cd-bb11-cf902fb090d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e9:f6,bridge_name='br-int',has_traffic_filtering=True,id=b6d1ceb1-c884-47cd-bb11-cf902fb090d3,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d1ceb1-c8') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG os_vif [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e9:f6,bridge_name='br-int',has_traffic_filtering=True,id=b6d1ceb1-c884-47cd-bb11-cf902fb090d3,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d1ceb1-c8') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6d1ceb1-c8, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a75a959-c055-464c-a887-90658e9ec782) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:11 user nova-compute[76815]: INFO os_vif [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e9:f6,bridge_name='br-int',has_traffic_filtering=True,id=b6d1ceb1-c884-47cd-bb11-cf902fb090d3,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6d1ceb1-c8')
Nov 14 22:11:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Deleting instance files /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033_del
Nov 14 22:11:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Deletion of /opt/stack/data/nova/instances/4f27c15c-c2d3-4a4c-af05-3a91b4fe3033_del complete
Nov 14 22:11:11 user nova-compute[76815]: INFO nova.compute.manager [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 22:11:11 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:11:11 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:11:12 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba9c5ab3-2123-4656-bb8d-2a026f98deed req-c6f2c32e-1901-42c5-ac0a-c620dceb60b4 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received event network-vif-deleted-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:12 user nova-compute[76815]: INFO nova.compute.manager [req-ba9c5ab3-2123-4656-bb8d-2a026f98deed req-c6f2c32e-1901-42c5-ac0a-c620dceb60b4 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Neutron deleted interface b6d1ceb1-c884-47cd-bb11-cf902fb090d3; detaching it from the instance and deleting it from the info cache
Nov 14 22:11:12 user nova-compute[76815]: DEBUG nova.network.neutron [req-ba9c5ab3-2123-4656-bb8d-2a026f98deed req-c6f2c32e-1901-42c5-ac0a-c620dceb60b4 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:12 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Took 0.66 seconds to deallocate network for instance.
Nov 14 22:11:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba9c5ab3-2123-4656-bb8d-2a026f98deed req-c6f2c32e-1901-42c5-ac0a-c620dceb60b4 service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Detach interface failed, port_id=b6d1ceb1-c884-47cd-bb11-cf902fb090d3, reason: Instance 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:11:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:12 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:12 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:12 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Deleted allocations for instance 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033
Nov 14 22:11:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-931c5b15-aba0-420a-a8b7-24f10d5c22aa tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.122s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-929fe0bc-601a-4b73-9cff-e9e7a0fc4c81 req-c5ae8fb6-908a-4ee5-b9fb-0c1d20d0c53e service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received event network-vif-plugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-929fe0bc-601a-4b73-9cff-e9e7a0fc4c81 req-c5ae8fb6-908a-4ee5-b9fb-0c1d20d0c53e service nova] Acquiring lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-929fe0bc-601a-4b73-9cff-e9e7a0fc4c81 req-c5ae8fb6-908a-4ee5-b9fb-0c1d20d0c53e service nova] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-929fe0bc-601a-4b73-9cff-e9e7a0fc4c81 req-c5ae8fb6-908a-4ee5-b9fb-0c1d20d0c53e service nova] Lock "4f27c15c-c2d3-4a4c-af05-3a91b4fe3033-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-929fe0bc-601a-4b73-9cff-e9e7a0fc4c81 req-c5ae8fb6-908a-4ee5-b9fb-0c1d20d0c53e service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] No waiting events found dispatching network-vif-plugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:13 user nova-compute[76815]: WARNING nova.compute.manager [req-929fe0bc-601a-4b73-9cff-e9e7a0fc4c81 req-c5ae8fb6-908a-4ee5-b9fb-0c1d20d0c53e service nova] [instance: 4f27c15c-c2d3-4a4c-af05-3a91b4fe3033] Received unexpected event network-vif-plugged-b6d1ceb1-c884-47cd-bb11-cf902fb090d3 for instance with vm_state deleted and task_state None.
Nov 14 22:11:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "adac433a-262e-49c1-b7c6-cc99dc88afa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:17 user nova-compute[76815]: INFO nova.compute.manager [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Terminating instance
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Instance destroyed successfully.
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.objects.instance [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lazy-loading 'resources' on Instance uuid adac433a-262e-49c1-b7c6-cc99dc88afa3 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1296427425',display_name='tempest-ServersNegativeTestJSON-server-1296427425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1296427425',id=12,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:09:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bde13b6fb9174200aecd89b17c2b675e',ramdisk_id='',reservation_id='r-78jjglu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1003137324',owner_user_name='tempest-ServersNegativeTestJSON-1003137324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:09:33Z,user_data=None,user_id='494ca9737a354c719f4b286053f7a1b4',uuid=adac433a-262e-49c1-b7c6-cc99dc88afa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converting VIF {"id": "2de64b24-7921-4b71-9443-8b945b2058c6", "address": "fa:16:3e:33:c5:c3", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de64b24-79", "ovs_interfaceid": "2de64b24-7921-4b71-9443-8b945b2058c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c5:c3,bridge_name='br-int',has_traffic_filtering=True,id=2de64b24-7921-4b71-9443-8b945b2058c6,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de64b24-79') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG os_vif [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c5:c3,bridge_name='br-int',has_traffic_filtering=True,id=2de64b24-7921-4b71-9443-8b945b2058c6,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de64b24-79') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2de64b24-79, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4567d30-3cbe-4e4b-b7e1-c591547f7376) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:17 user nova-compute[76815]: INFO os_vif [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c5:c3,bridge_name='br-int',has_traffic_filtering=True,id=2de64b24-7921-4b71-9443-8b945b2058c6,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2de64b24-79')
Nov 14 22:11:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Deleting instance files /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3_del
Nov 14 22:11:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Deletion of /opt/stack/data/nova/instances/adac433a-262e-49c1-b7c6-cc99dc88afa3_del complete
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-e2b4ac66-14a8-4d25-915e-6e1196d8b60d req-157c6f42-4826-42f7-a2c6-4f643badd2ef service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received event network-vif-unplugged-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e2b4ac66-14a8-4d25-915e-6e1196d8b60d req-157c6f42-4826-42f7-a2c6-4f643badd2ef service nova] Acquiring lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e2b4ac66-14a8-4d25-915e-6e1196d8b60d req-157c6f42-4826-42f7-a2c6-4f643badd2ef service nova] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e2b4ac66-14a8-4d25-915e-6e1196d8b60d req-157c6f42-4826-42f7-a2c6-4f643badd2ef service nova] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-e2b4ac66-14a8-4d25-915e-6e1196d8b60d req-157c6f42-4826-42f7-a2c6-4f643badd2ef service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] No waiting events found dispatching network-vif-unplugged-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-e2b4ac66-14a8-4d25-915e-6e1196d8b60d req-157c6f42-4826-42f7-a2c6-4f643badd2ef service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received event network-vif-unplugged-2de64b24-7921-4b71-9443-8b945b2058c6 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:17 user nova-compute[76815]: INFO nova.compute.manager [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Terminating instance
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:11:17 user nova-compute[76815]: INFO nova.compute.manager [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 22:11:17 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-efe2b6de-2c11-4400-8eae-28981e58dc9e req-a06c69db-43f3-486e-9b8e-4cfca8bd3ca1 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-unplugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-efe2b6de-2c11-4400-8eae-28981e58dc9e req-a06c69db-43f3-486e-9b8e-4cfca8bd3ca1 service nova] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-efe2b6de-2c11-4400-8eae-28981e58dc9e req-a06c69db-43f3-486e-9b8e-4cfca8bd3ca1 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-efe2b6de-2c11-4400-8eae-28981e58dc9e req-a06c69db-43f3-486e-9b8e-4cfca8bd3ca1 service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-efe2b6de-2c11-4400-8eae-28981e58dc9e req-a06c69db-43f3-486e-9b8e-4cfca8bd3ca1 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] No waiting events found dispatching network-vif-unplugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-efe2b6de-2c11-4400-8eae-28981e58dc9e req-a06c69db-43f3-486e-9b8e-4cfca8bd3ca1 service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-unplugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Instance destroyed successfully.
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.objects.instance [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lazy-loading 'resources' on Instance uuid 91830a3a-8395-4f82-81c3-6aec79a46c33 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T22:07:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-239797802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-239797802',id=6,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp1I2ExuD5M3u6m5DSKi2h8Sbi9eJkAW82TUikZkZ6/CmyHFgzEt+tH3XphSvsi+i6IpnxEg23xGXTPTV8VZcAvDG1z9g4zldZJtkz5P+3Huuf8Uxsjfoa/XNo/Ex9vg==',key_name='tempest-keypair-1648996082',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f304c47366c4cd1af23a1f0d43d8825',ramdisk_id='',reservation_id='r-m3vhi65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1610929038',owner_user_name='tempest-TaggedAttachmentsTest-1610929038-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3356e497cd5243beb1e6d5aa0b24a177',uuid=91830a3a-8395-4f82-81c3-6aec79a46c33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converting VIF {"id": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "address": "fa:16:3e:21:d0:50", "network": {"id": "38dbc616-1fd6-4fe5-8ad0-00f3bf562906", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1879483759-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f304c47366c4cd1af23a1f0d43d8825", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5688ed4c-da", "ovs_interfaceid": "5688ed4c-da6e-445f-9839-2d49c9724bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=5688ed4c-da6e-445f-9839-2d49c9724bc8,network=Network(38dbc616-1fd6-4fe5-8ad0-00f3bf562906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5688ed4c-da') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG os_vif [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=5688ed4c-da6e-445f-9839-2d49c9724bc8,network=Network(38dbc616-1fd6-4fe5-8ad0-00f3bf562906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5688ed4c-da') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5688ed4c-da, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddad2a43-915b-4c25-a146-783318e69991) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:18 user nova-compute[76815]: INFO os_vif [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d0:50,bridge_name='br-int',has_traffic_filtering=True,id=5688ed4c-da6e-445f-9839-2d49c9724bc8,network=Network(38dbc616-1fd6-4fe5-8ad0-00f3bf562906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5688ed4c-da')
Nov 14 22:11:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Deleting instance files /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33_del
Nov 14 22:11:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Deletion of /opt/stack/data/nova/instances/91830a3a-8395-4f82-81c3-6aec79a46c33_del complete
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:18 user nova-compute[76815]: INFO nova.compute.manager [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 22:11:18 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:11:18 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Took 0.89 seconds to deallocate network for instance.
Nov 14 22:11:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:19 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:19 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Deleted allocations for instance adac433a-262e-49c1-b7c6-cc99dc88afa3
Nov 14 22:11:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9482d446-2976-42b4-ade9-82e1ce118a94 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.272s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-50a3c147-2efb-44a9-a4e5-74b7c29383e1 req-5a0b667b-30e9-4246-87ab-5c824deee5d4 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received event network-vif-plugged-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50a3c147-2efb-44a9-a4e5-74b7c29383e1 req-5a0b667b-30e9-4246-87ab-5c824deee5d4 service nova] Acquiring lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50a3c147-2efb-44a9-a4e5-74b7c29383e1 req-5a0b667b-30e9-4246-87ab-5c824deee5d4 service nova] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50a3c147-2efb-44a9-a4e5-74b7c29383e1 req-5a0b667b-30e9-4246-87ab-5c824deee5d4 service nova] Lock "adac433a-262e-49c1-b7c6-cc99dc88afa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-50a3c147-2efb-44a9-a4e5-74b7c29383e1 req-5a0b667b-30e9-4246-87ab-5c824deee5d4 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] No waiting events found dispatching network-vif-plugged-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:19 user nova-compute[76815]: WARNING nova.compute.manager [req-50a3c147-2efb-44a9-a4e5-74b7c29383e1 req-5a0b667b-30e9-4246-87ab-5c824deee5d4 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received unexpected event network-vif-plugged-2de64b24-7921-4b71-9443-8b945b2058c6 for instance with vm_state deleted and task_state None.
Nov 14 22:11:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-50a3c147-2efb-44a9-a4e5-74b7c29383e1 req-5a0b667b-30e9-4246-87ab-5c824deee5d4 service nova] [instance: adac433a-262e-49c1-b7c6-cc99dc88afa3] Received event network-vif-deleted-2de64b24-7921-4b71-9443-8b945b2058c6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:19 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:19 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Took 1.18 seconds to deallocate network for instance.
Nov 14 22:11:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:20 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:20 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:20 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Deleted allocations for instance 91830a3a-8395-4f82-81c3-6aec79a46c33
Nov 14 22:11:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-47189fb7-a33c-4884-920c-085e6bdef346 req-07edc5bb-5552-43c2-a2f1-95ad29b05c0c service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-plugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-47189fb7-a33c-4884-920c-085e6bdef346 req-07edc5bb-5552-43c2-a2f1-95ad29b05c0c service nova] Acquiring lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-47189fb7-a33c-4884-920c-085e6bdef346 req-07edc5bb-5552-43c2-a2f1-95ad29b05c0c service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-47189fb7-a33c-4884-920c-085e6bdef346 req-07edc5bb-5552-43c2-a2f1-95ad29b05c0c service nova] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-47189fb7-a33c-4884-920c-085e6bdef346 req-07edc5bb-5552-43c2-a2f1-95ad29b05c0c service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] No waiting events found dispatching network-vif-plugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:20 user nova-compute[76815]: WARNING nova.compute.manager [req-47189fb7-a33c-4884-920c-085e6bdef346 req-07edc5bb-5552-43c2-a2f1-95ad29b05c0c service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received unexpected event network-vif-plugged-5688ed4c-da6e-445f-9839-2d49c9724bc8 for instance with vm_state deleted and task_state None.
Nov 14 22:11:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-065f88c7-c34e-4274-a35d-d79e0ac4d077 tempest-TaggedAttachmentsTest-1610929038 tempest-TaggedAttachmentsTest-1610929038-project-member] Lock "91830a3a-8395-4f82-81c3-6aec79a46c33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.649s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-35012437-e9b6-425d-917a-1a9e9c4f7ca7 req-6220805a-022d-4084-9fde-617b063158fd service nova] [instance: 91830a3a-8395-4f82-81c3-6aec79a46c33] Received event network-vif-deleted-5688ed4c-da6e-445f-9839-2d49c9724bc8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG nova.objects.instance [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lazy-loading 'flavor' on Instance uuid 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:22 user nova-compute[76815]: INFO nova.compute.manager [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Attaching volume 925a86c5-4658-4b61-9360-7b14b96cfe4f to /dev/vdb
Nov 14 22:11:22 user nova-compute[76815]: DEBUG os_brick.utils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80fa22f-2b74-42ab-ab25-3085468024cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdc2761-85fd-4f5b-92f1-8053314205be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8871f-85e9-4037-a997-554622e0737a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe76c50-5aa5-423e-b205-b2c502189809]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:11:22 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:11:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7570e4-ff0c-470f-8ae9-84934860dfb1]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG os_brick.utils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:11:22 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating existing volume attachment record: 516f879a-3376-47c9-ab93-0e58552044a8 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:11:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:23 user nova-compute[76815]: INFO nova.compute.manager [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Terminating instance
Nov 14 22:11:23 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:11:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-9e393a95-d07d-4f51-b976-af6243b9db75 req-3f926932-1058-4d42-9202-bce7a783421a service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received event network-vif-unplugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9e393a95-d07d-4f51-b976-af6243b9db75 req-3f926932-1058-4d42-9202-bce7a783421a service nova] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9e393a95-d07d-4f51-b976-af6243b9db75 req-3f926932-1058-4d42-9202-bce7a783421a service nova] Lock "ab3b7495-76be-421d-9843-af965b815413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9e393a95-d07d-4f51-b976-af6243b9db75 req-3f926932-1058-4d42-9202-bce7a783421a service nova] Lock "ab3b7495-76be-421d-9843-af965b815413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-9e393a95-d07d-4f51-b976-af6243b9db75 req-3f926932-1058-4d42-9202-bce7a783421a service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] No waiting events found dispatching network-vif-unplugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-9e393a95-d07d-4f51-b976-af6243b9db75 req-3f926932-1058-4d42-9202-bce7a783421a service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received event network-vif-unplugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: ab3b7495-76be-421d-9843-af965b815413] Instance destroyed successfully.
Nov 14 22:11:24 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lazy-loading 'resources' on Instance uuid ab3b7495-76be-421d-9843-af965b815413 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1798569789',display_name='tempest-TestVolumeSwap-server-1798569789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1798569789',id=7,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxEXuy2KN9PYIaEVKPEZBzlkx9bY5ojOv43XV8JKQqwKOKCoqP8czbRKZeplBPuNCxUqgqQOc8AZZeTQiqwRLSsk4qUTxur0pqzLAooMbpOj9M8Og4dMdnF2V6mnEb2gA==',key_name='tempest-keypair-137952451',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='999bc848ab4843739549ca07ab50e2f2',ramdisk_id='',reservation_id='r-4puo170d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-654708364',owner_user_name='tempest-TestVolumeSwap-654708364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac44b3e767af4aafbf494fbe992dd138',uuid=ab3b7495-76be-421d-9843-af965b815413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Converting VIF {"id": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "address": "fa:16:3e:ee:90:44", "network": {"id": "2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1461799092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "999bc848ab4843739549ca07ab50e2f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a1d68c-a4", "ovs_interfaceid": "f1a1d68c-a423-4b04-a0ac-b9b345bb91c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:90:44,bridge_name='br-int',has_traffic_filtering=True,id=f1a1d68c-a423-4b04-a0ac-b9b345bb91c0,network=Network(2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a1d68c-a4') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG os_vif [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:90:44,bridge_name='br-int',has_traffic_filtering=True,id=f1a1d68c-a423-4b04-a0ac-b9b345bb91c0,network=Network(2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a1d68c-a4') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1a1d68c-a4, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc234e9e-1273-4e97-ac75-69ee5b6516ca) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:24 user nova-compute[76815]: INFO os_vif [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:90:44,bridge_name='br-int',has_traffic_filtering=True,id=f1a1d68c-a423-4b04-a0ac-b9b345bb91c0,network=Network(2fe5b1d2-3325-43ca-b4fc-60fa96dac3a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a1d68c-a4')
Nov 14 22:11:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Deleting instance files /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413_del
Nov 14 22:11:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Deletion of /opt/stack/data/nova/instances/ab3b7495-76be-421d-9843-af965b815413_del complete
Nov 14 22:11:24 user nova-compute[76815]: INFO nova.compute.manager [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] [instance: ab3b7495-76be-421d-9843-af965b815413] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 22:11:24 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: ab3b7495-76be-421d-9843-af965b815413] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:11:24 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: ab3b7495-76be-421d-9843-af965b815413] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:11:26 user nova-compute[76815]: DEBUG nova.compute.manager [req-73616de2-db90-47b7-aba7-ce3f05892c29 req-7466c05a-4102-4c64-b720-fa623f675705 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received event network-vif-plugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-73616de2-db90-47b7-aba7-ce3f05892c29 req-7466c05a-4102-4c64-b720-fa623f675705 service nova] Acquiring lock "ab3b7495-76be-421d-9843-af965b815413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-73616de2-db90-47b7-aba7-ce3f05892c29 req-7466c05a-4102-4c64-b720-fa623f675705 service nova] Lock "ab3b7495-76be-421d-9843-af965b815413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-73616de2-db90-47b7-aba7-ce3f05892c29 req-7466c05a-4102-4c64-b720-fa623f675705 service nova] Lock "ab3b7495-76be-421d-9843-af965b815413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:26 user nova-compute[76815]: DEBUG nova.compute.manager [req-73616de2-db90-47b7-aba7-ce3f05892c29 req-7466c05a-4102-4c64-b720-fa623f675705 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] No waiting events found dispatching network-vif-plugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:26 user nova-compute[76815]: WARNING nova.compute.manager [req-73616de2-db90-47b7-aba7-ce3f05892c29 req-7466c05a-4102-4c64-b720-fa623f675705 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received unexpected event network-vif-plugged-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 for instance with vm_state active and task_state deleting.
Nov 14 22:11:26 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: ab3b7495-76be-421d-9843-af965b815413] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:26 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: ab3b7495-76be-421d-9843-af965b815413] Took 1.46 seconds to deallocate network for instance.
Nov 14 22:11:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:26 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:26 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:26 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Deleted allocations for instance ab3b7495-76be-421d-9843-af965b815413
Nov 14 22:11:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0190ce8b-4a9a-4e0a-9284-1f5c99ca51a4 tempest-TestVolumeSwap-654708364 tempest-TestVolumeSwap-654708364-project-member] Lock "ab3b7495-76be-421d-9843-af965b815413" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:11:27 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:11:27 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:11:27 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b59bd1-8795-4fa1-859a-d0e88728b355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:11:27 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df5a998-eb78-4866-a70f-3619bee61893]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f] added
Nov 14 22:11:27 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9128bc47-29be-4edc-9f52-820912fdf26c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e69e3f-1ce8-47bc-92ad-48093a885fa2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v doZtJFaw {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v doZtJFaw" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83caccb-ab5f-4545-a9a6-fa39a0578d54]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'doZtJFaw'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f7c1af-3871-4744-b2ef-f6310d062939]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f0d559-6d4c-42a2-94b3-6a46de3a4758]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:11:27 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:11:27 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4f13a4-62fa-4bc6-a04b-fefab3ebb78f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]
Nov 14 22:11:27 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.
Nov 14 22:11:27 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5069895f-2643-44da-aec6-4a68fad1f266]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02a7cdc-f64c-4d5c-9f1e-bb5b80249018]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:11:27 user nova-compute[76815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:11:27 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:11:27 user nova-compute[76815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:11:27 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e15c137-5d36-41c9-b207-e42001e5d918]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:27 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-9939f2f6-2ecb-4b94-b436-30259556c2d7 req-e2e54b32-95f0-4995-ad49-868ff91ce5e3 service nova] [instance: ab3b7495-76be-421d-9843-af965b815413] Received event network-vif-deleted-f1a1d68c-a423-4b04-a0ac-b9b345bb91c0 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23037666264373761', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037666264373761', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lazy-loading 'flavor' on Instance uuid 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:11:28 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:11:28 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:11:28 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:11:28 user nova-compute[76815]:   <serial>925a86c5-4658-4b61-9360-7b14b96cfe4f</serial>
Nov 14 22:11:28 user nova-compute[76815]: </disk>
Nov 14 22:11:28 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:11:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:11:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:11:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] No VIF found with MAC fa:16:3e:33:73:f8, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:11:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b95314a2-34ab-4be7-9cce-b254d098af75 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.922s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:32 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:11:32 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8062MB free_disk=25.54656982421875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:32 user nova-compute[76815]: INFO nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating resource usage from migration ff042c3f-3a4f-4cfe-9681-d977ea50d8f9
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bb235db0-61d3-4e29-9794-b7c181f074d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 16c58923-c97e-4148-af31-9609b9af5d80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a4c05bc3-b996-4312-8276-a395c7802a1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Migration ff042c3f-3a4f-4cfe-9681-d977ea50d8f9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Stashing vm_state: active {{(pid=76815) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:11:33 user nova-compute[76815]: INFO nova.compute.claims [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Claim successful on node user
Nov 14 22:11:33 user nova-compute[76815]: INFO nova.compute.resource_tracker [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating resource usage from migration ff042c3f-3a4f-4cfe-9681-d977ea50d8f9
Nov 14 22:11:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.332s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:33 user nova-compute[76815]: INFO nova.compute.manager [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Migrating
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquired lock "compute-rpcapi-router" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:11:33 user nova-compute[76815]: INFO nova.compute.rpcapi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Releasing lock "compute-rpcapi-router" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquired lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:11:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:11:34 user nova-compute[76815]: INFO nova.compute.claims [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Claim successful on node user
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Releasing lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Starting migrate_disk_and_power_off {{(pid=76815) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:35 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.policy [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6ef0744ff3b459b9e32404ec12bbe55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327b9fb17cb74bb0a56380b0d084cec3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:11:35 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Creating image(s)
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "/opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "/opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-166306fa-2c63-4883-bba6-a02ed3aa769c req-34ff447b-0956-489a-bbb1-e6ee1db620bd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-166306fa-2c63-4883-bba6-a02ed3aa769c req-34ff447b-0956-489a-bbb1-e6ee1db620bd service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-166306fa-2c63-4883-bba6-a02ed3aa769c req-34ff447b-0956-489a-bbb1-e6ee1db620bd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-166306fa-2c63-4883-bba6-a02ed3aa769c req-34ff447b-0956-489a-bbb1-e6ee1db620bd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-166306fa-2c63-4883-bba6-a02ed3aa769c req-34ff447b-0956-489a-bbb1-e6ee1db620bd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:35 user nova-compute[76815]: WARNING nova.compute.manager [req-166306fa-2c63-4883-bba6-a02ed3aa769c req-34ff447b-0956-489a-bbb1-e6ee1db620bd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state active and task_state resize_migrating.
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.204s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updating instance_info_cache with network_info: [{"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-16c58923-c97e-4148-af31-9609b9af5d80" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:11:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.224s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk 1073741824" returned: 0 in 0.073s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance destroyed successfully.
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-740046946',display_name='tempest-ServerActionsTestOtherB-server-740046946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-740046946',id=2,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfyvibJFZ3+P9cPClSwRvADUm92jfJ8o6BTO5uqmymmHB851px3NqgPd2QQeHEC+IldkPYJsk/5QKXvtU1Q/t5lYj1GQkm68rGyQFBVBYEDC0MsPp+SZUuhpQDRtsF5Yw==',key_name='tempest-keypair-689678311',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3021ff6fd9ad4958a9907c1b75f89a56',ramdisk_id='',reservation_id='r-uw1mr160',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-614422799',owner_user_name='tempest-ServerActionsTestOtherB-614422799-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82120460b2945879455016ed97cafe9',uuid=2a7d6b8f-698f-4e0b-a28e-131121d8fe8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1630974441-network", "vif_mac": "fa:16:3e:33:73:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converting VIF {"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1630974441-network", "vif_mac": "fa:16:3e:33:73:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_vif [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b0d4dc-1d, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9faf599c-79ae-4794-9c71-bcd0f6ae910a) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:36 user nova-compute[76815]: INFO os_vif [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d')
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:11:36 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.network.neutron [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Successfully created port: 2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d18e331-e333-401f-b94f-81df0f870369]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:11:36 user nova-compute[76815]: No targets found.
Nov 14 22:11:36 user nova-compute[76815]: iSNS:
Nov 14 22:11:36 user nova-compute[76815]: No targets found.
Nov 14 22:11:36 user nova-compute[76815]: STATIC:
Nov 14 22:11:36 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:11:36 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:11:36 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:11:36 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f
Nov 14 22:11:36 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:11:36 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:11:36 user nova-compute[76815]: FIRMWARE:
Nov 14 22:11:36 user nova-compute[76815]: No targets found.
Nov 14 22:11:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:11:36 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:11:36 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd940cc-cb72-491b-9e5a-21b5de6919c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc06592-8a4a-4765-87c8-5e4d55c78a5a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:11:36 user nova-compute[76815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:11:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:11:36 user nova-compute[76815]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:11:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4504f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d718a90-5a99-492c-9d6e-270b8dd37cda]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e44e85-1b5d-4499-a063-d692734f90d2]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.198s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5034c0cb-6528-49d2-951c-95e6bc6a42bd]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7b31eb-ddb3-423e-931f-f6a453442255]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85e2cbe-6eda-4fa7-b514-be0be3784c8a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4af2c7-0c8d-45a6-9d34-1163d745f7d9]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]
Nov 14 22:11:36 user nova-compute[76815]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.
Nov 14 22:11:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Cannot resize image /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Ensure instance console log exists: /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff9c166-f33a-483a-b908-ffb6421669a7]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] <== disconnect_volume: return (324ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.network.neutron [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Successfully updated port: 2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquired lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.network.neutron [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-a6b7cc91-b9c9-4e55-b84c-a785f7b5f814 req-6fe8a160-f071-4213-9dcd-083fd19c2a74 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received event network-changed-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-a6b7cc91-b9c9-4e55-b84c-a785f7b5f814 req-6fe8a160-f071-4213-9dcd-083fd19c2a74 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Refreshing instance network info cache due to event network-changed-2c08b739-bf8a-4e86-ae64-9afa96802414. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a6b7cc91-b9c9-4e55-b84c-a785f7b5f814 req-6fe8a160-f071-4213-9dcd-083fd19c2a74 service nova] Acquiring lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:11:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a_resize/disk /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updating instance_info_cache with network_info: [{"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Releasing lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Instance network_info: |[{"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a6b7cc91-b9c9-4e55-b84c-a785f7b5f814 req-6fe8a160-f071-4213-9dcd-083fd19c2a74 service nova] Acquired lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-a6b7cc91-b9c9-4e55-b84c-a785f7b5f814 req-6fe8a160-f071-4213-9dcd-083fd19c2a74 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Refreshing network info cache for port 2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Start _get_guest_xml network_info=[{"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:11:37 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:11:37 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1919742082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1919742082',id=14,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-9byn0070',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:11:35Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=a8bb243d-ad93-47ae-8fbe-b5845a29496d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e4:d1,bridge_name='br-int',has_traffic_filtering=True,id=2c08b739-bf8a-4e86-ae64-9afa96802414,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c08b739-bf') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.objects.instance [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'pci_devices' on Instance uuid a8bb243d-ad93-47ae-8fbe-b5845a29496d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:11:37 user nova-compute[76815]:   <uuid>a8bb243d-ad93-47ae-8fbe-b5845a29496d</uuid>
Nov 14 22:11:37 user nova-compute[76815]:   <name>instance-0000000e</name>
Nov 14 22:11:37 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:11:37 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:11:37 user nova-compute[76815]:   <metadata>
Nov 14 22:11:37 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:11:37 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:11:37 user nova-compute[76815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1919742082</nova:name>
Nov 14 22:11:37 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:11:37</nova:creationTime>
Nov 14 22:11:37 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:11:37 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:11:37 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:11:37 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:11:37 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:11:37 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:11:37 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:11:37 user nova-compute[76815]:       <nova:owner>
Nov 14 22:11:37 user nova-compute[76815]:         <nova:user uuid="a6ef0744ff3b459b9e32404ec12bbe55">tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member</nova:user>
Nov 14 22:11:37 user nova-compute[76815]:         <nova:project uuid="327b9fb17cb74bb0a56380b0d084cec3">tempest-ServerBootFromVolumeStableRescueTest-890378304</nova:project>
Nov 14 22:11:37 user nova-compute[76815]:       </nova:owner>
Nov 14 22:11:37 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:11:37 user nova-compute[76815]:       <nova:ports>
Nov 14 22:11:37 user nova-compute[76815]:         <nova:port uuid="2c08b739-bf8a-4e86-ae64-9afa96802414">
Nov 14 22:11:37 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 22:11:37 user nova-compute[76815]:         </nova:port>
Nov 14 22:11:37 user nova-compute[76815]:       </nova:ports>
Nov 14 22:11:37 user nova-compute[76815]:     </nova:instance>
Nov 14 22:11:37 user nova-compute[76815]:   </metadata>
Nov 14 22:11:37 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:11:37 user nova-compute[76815]:     <system>
Nov 14 22:11:37 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:11:37 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:11:37 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:11:37 user nova-compute[76815]:       <entry name="serial">a8bb243d-ad93-47ae-8fbe-b5845a29496d</entry>
Nov 14 22:11:37 user nova-compute[76815]:       <entry name="uuid">a8bb243d-ad93-47ae-8fbe-b5845a29496d</entry>
Nov 14 22:11:37 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:11:37 user nova-compute[76815]:     </system>
Nov 14 22:11:37 user nova-compute[76815]:   </sysinfo>
Nov 14 22:11:37 user nova-compute[76815]:   <os>
Nov 14 22:11:37 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:11:37 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:11:37 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:11:37 user nova-compute[76815]:   </os>
Nov 14 22:11:37 user nova-compute[76815]:   <features>
Nov 14 22:11:37 user nova-compute[76815]:     <acpi/>
Nov 14 22:11:37 user nova-compute[76815]:     <apic/>
Nov 14 22:11:37 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:11:37 user nova-compute[76815]:   </features>
Nov 14 22:11:37 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:11:37 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:11:37 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:11:37 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:11:37 user nova-compute[76815]:   </clock>
Nov 14 22:11:37 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:11:37 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:11:37 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:11:37 user nova-compute[76815]:   </cpu>
Nov 14 22:11:37 user nova-compute[76815]:   <devices>
Nov 14 22:11:37 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:11:37 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:11:37 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk"/>
Nov 14 22:11:37 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:11:37 user nova-compute[76815]:     </disk>
Nov 14 22:11:37 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:11:37 user nova-compute[76815]:       <mac address="fa:16:3e:e5:e4:d1"/>
Nov 14 22:11:37 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:11:37 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:11:37 user nova-compute[76815]:       <target dev="tap2c08b739-bf"/>
Nov 14 22:11:37 user nova-compute[76815]:     </interface>
Nov 14 22:11:37 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:11:37 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/console.log" append="off"/>
Nov 14 22:11:37 user nova-compute[76815]:     </serial>
Nov 14 22:11:37 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:11:37 user nova-compute[76815]:     <video>
Nov 14 22:11:37 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:11:37 user nova-compute[76815]:     </video>
Nov 14 22:11:37 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:11:37 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:11:37 user nova-compute[76815]:     </rng>
Nov 14 22:11:37 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:11:37 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:11:37 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:11:37 user nova-compute[76815]:     </memballoon>
Nov 14 22:11:37 user nova-compute[76815]:   </devices>
Nov 14 22:11:37 user nova-compute[76815]: </domain>
Nov 14 22:11:37 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1919742082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1919742082',id=14,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-9byn0070',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:11:35Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=a8bb243d-ad93-47ae-8fbe-b5845a29496d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e4:d1,bridge_name='br-int',has_traffic_filtering=True,id=2c08b739-bf8a-4e86-ae64-9afa96802414,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c08b739-bf') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG os_vif [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e4:d1,bridge_name='br-int',has_traffic_filtering=True,id=2c08b739-bf8a-4e86-ae64-9afa96802414,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c08b739-bf') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-8430a346-babd-4dd8-b75d-6174277a8aee req-ea55642a-7198-432c-93ea-fcc835ce1f63 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8430a346-babd-4dd8-b75d-6174277a8aee req-ea55642a-7198-432c-93ea-fcc835ce1f63 service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8430a346-babd-4dd8-b75d-6174277a8aee req-ea55642a-7198-432c-93ea-fcc835ce1f63 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8430a346-babd-4dd8-b75d-6174277a8aee req-ea55642a-7198-432c-93ea-fcc835ce1f63 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-8430a346-babd-4dd8-b75d-6174277a8aee req-ea55642a-7198-432c-93ea-fcc835ce1f63 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:37 user nova-compute[76815]: WARNING nova.compute.manager [req-8430a346-babd-4dd8-b75d-6174277a8aee req-ea55642a-7198-432c-93ea-fcc835ce1f63 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state active and task_state resize_migrating.
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1714bcea-9060-593d-aa31-b1a9d10545d4', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c08b739-bf, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c08b739-bf, col_values=(('qos', UUID('ad7ca9dd-dc43-4264-8c5a-4ea7f063d7da')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c08b739-bf, col_values=(('external_ids', {'iface-id': '2c08b739-bf8a-4e86-ae64-9afa96802414', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:e4:d1', 'vm-uuid': 'a8bb243d-ad93-47ae-8fbe-b5845a29496d'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:37 user nova-compute[76815]: INFO os_vif [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e4:d1,bridge_name='br-int',has_traffic_filtering=True,id=2c08b739-bf8a-4e86-ae64-9afa96802414,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c08b739-bf')
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No VIF found with MAC fa:16:3e:e5:e4:d1, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "cp -r /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a_resize/disk /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk" returned: 0 in 1.014s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a_resize/disk.info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk.info {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "cp -r /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a_resize/disk.info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk.info" returned: 0 in 0.038s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.network.neutron [req-a6b7cc91-b9c9-4e55-b84c-a785f7b5f814 req-6fe8a160-f071-4213-9dcd-083fd19c2a74 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updated VIF entry in instance network info cache for port 2c08b739-bf8a-4e86-ae64-9afa96802414. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.network.neutron [req-a6b7cc91-b9c9-4e55-b84c-a785f7b5f814 req-6fe8a160-f071-4213-9dcd-083fd19c2a74 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updating instance_info_cache with network_info: [{"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a6b7cc91-b9c9-4e55-b84c-a785f7b5f814 req-6fe8a160-f071-4213-9dcd-083fd19c2a74 service nova] Releasing lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "065c90e1-2099-4446-a998-de681bedf500" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "065c90e1-2099-4446-a998-de681bedf500" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:11:38 user nova-compute[76815]: INFO nova.compute.claims [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Claim successful on node user
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:11:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:11:38 user nova-compute[76815]: DEBUG nova.policy [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85a900897f3a42bd89f966f4b7e253f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7e88b0ec54c5b9f15ae859e8c3984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:11:39 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Creating image(s)
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "/opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "/opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "/opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk 1073741824" returned: 0 in 0.071s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.202s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Checking if we can resize image /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Port 01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae binding to destination host user is already ACTIVE {{(pid=76815) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Successfully created port: dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Cannot resize image /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Ensure instance console log exists: /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquired lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Releasing lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG os_brick.utils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a101a906-7e94-479e-a345-097807c380d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b616a7cb-e99e-44e0-bd12-2a53f0e44cde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a01046-e879-4e72-b676-d576492de860]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3144172-a3a1-4624-a92a-e23ad6206b9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:11:40 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f597b538-d28f-45c0-99ce-45d188761d44]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG os_brick.utils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Successfully updated port: dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquired lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-e43c697e-26dc-481f-bbd4-59520950d0c9 req-6eda51fd-8f4e-410a-87f7-54dd0d44dbde service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received event network-changed-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-e43c697e-26dc-481f-bbd4-59520950d0c9 req-6eda51fd-8f4e-410a-87f7-54dd0d44dbde service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Refreshing instance network info cache due to event network-changed-dc5e49f0-2f7c-4750-86ab-270834c97d82. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e43c697e-26dc-481f-bbd4-59520950d0c9 req-6eda51fd-8f4e-410a-87f7-54dd0d44dbde service nova] Acquiring lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:11:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-8cde6e7b-9116-409d-93f3-e3ae1e90e5fa req-a2d6b3f8-e1bd-484a-8f2e-260dfa46cae7 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received event network-vif-plugged-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8cde6e7b-9116-409d-93f3-e3ae1e90e5fa req-a2d6b3f8-e1bd-484a-8f2e-260dfa46cae7 service nova] Acquiring lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8cde6e7b-9116-409d-93f3-e3ae1e90e5fa req-a2d6b3f8-e1bd-484a-8f2e-260dfa46cae7 service nova] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8cde6e7b-9116-409d-93f3-e3ae1e90e5fa req-a2d6b3f8-e1bd-484a-8f2e-260dfa46cae7 service nova] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-8cde6e7b-9116-409d-93f3-e3ae1e90e5fa req-a2d6b3f8-e1bd-484a-8f2e-260dfa46cae7 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] No waiting events found dispatching network-vif-plugged-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:41 user nova-compute[76815]: WARNING nova.compute.manager [req-8cde6e7b-9116-409d-93f3-e3ae1e90e5fa req-a2d6b3f8-e1bd-484a-8f2e-260dfa46cae7 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received unexpected event network-vif-plugged-2c08b739-bf8a-4e86-ae64-9afa96802414 for instance with vm_state building and task_state spawning.
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updating instance_info_cache with network_info: [{"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Releasing lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Instance network_info: |[{"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e43c697e-26dc-481f-bbd4-59520950d0c9 req-6eda51fd-8f4e-410a-87f7-54dd0d44dbde service nova] Acquired lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.network.neutron [req-e43c697e-26dc-481f-bbd4-59520950d0c9 req-6eda51fd-8f4e-410a-87f7-54dd0d44dbde service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Refreshing network info cache for port dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Start _get_guest_xml network_info=[{"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:11:41 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:11:41 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1093783850',display_name='tempest-ServerActionsTestOtherA-server-1093783850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1093783850',id=15,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVfME04PD9rglznppi8Ho3+jsumiOYFPtvR+yy+S2ej5C5M3kJOl8pyG4taHWLiqRqGcIU6SfKKWEu+JVsdH1FsdhxYcOosylxiuo+4fsZkdlqozg87LpEdVgLP6QXNw==',key_name='tempest-keypair-1998197341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-kbmqf7bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=065c90e1-2099-4446-a998-de681bedf500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d0:fd,bridge_name='br-int',has_traffic_filtering=True,id=dc5e49f0-2f7c-4750-86ab-270834c97d82,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5e49f0-2f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'pci_devices' on Instance uuid 065c90e1-2099-4446-a998-de681bedf500 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:11:41 user nova-compute[76815]:   <uuid>065c90e1-2099-4446-a998-de681bedf500</uuid>
Nov 14 22:11:41 user nova-compute[76815]:   <name>instance-0000000f</name>
Nov 14 22:11:41 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:11:41 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:11:41 user nova-compute[76815]:   <metadata>
Nov 14 22:11:41 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:11:41 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:11:41 user nova-compute[76815]:       <nova:name>tempest-ServerActionsTestOtherA-server-1093783850</nova:name>
Nov 14 22:11:41 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:11:41</nova:creationTime>
Nov 14 22:11:41 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:11:41 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:11:41 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:11:41 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:11:41 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:11:41 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:11:41 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:11:41 user nova-compute[76815]:       <nova:owner>
Nov 14 22:11:41 user nova-compute[76815]:         <nova:user uuid="85a900897f3a42bd89f966f4b7e253f6">tempest-ServerActionsTestOtherA-2016206168-project-member</nova:user>
Nov 14 22:11:41 user nova-compute[76815]:         <nova:project uuid="60b7e88b0ec54c5b9f15ae859e8c3984">tempest-ServerActionsTestOtherA-2016206168</nova:project>
Nov 14 22:11:41 user nova-compute[76815]:       </nova:owner>
Nov 14 22:11:41 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:11:41 user nova-compute[76815]:       <nova:ports>
Nov 14 22:11:41 user nova-compute[76815]:         <nova:port uuid="dc5e49f0-2f7c-4750-86ab-270834c97d82">
Nov 14 22:11:41 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:11:41 user nova-compute[76815]:         </nova:port>
Nov 14 22:11:41 user nova-compute[76815]:       </nova:ports>
Nov 14 22:11:41 user nova-compute[76815]:     </nova:instance>
Nov 14 22:11:41 user nova-compute[76815]:   </metadata>
Nov 14 22:11:41 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:11:41 user nova-compute[76815]:     <system>
Nov 14 22:11:41 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:11:41 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:11:41 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:11:41 user nova-compute[76815]:       <entry name="serial">065c90e1-2099-4446-a998-de681bedf500</entry>
Nov 14 22:11:41 user nova-compute[76815]:       <entry name="uuid">065c90e1-2099-4446-a998-de681bedf500</entry>
Nov 14 22:11:41 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:11:41 user nova-compute[76815]:     </system>
Nov 14 22:11:41 user nova-compute[76815]:   </sysinfo>
Nov 14 22:11:41 user nova-compute[76815]:   <os>
Nov 14 22:11:41 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:11:41 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:11:41 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:11:41 user nova-compute[76815]:   </os>
Nov 14 22:11:41 user nova-compute[76815]:   <features>
Nov 14 22:11:41 user nova-compute[76815]:     <acpi/>
Nov 14 22:11:41 user nova-compute[76815]:     <apic/>
Nov 14 22:11:41 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:11:41 user nova-compute[76815]:   </features>
Nov 14 22:11:41 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:11:41 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:11:41 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:11:41 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:11:41 user nova-compute[76815]:   </clock>
Nov 14 22:11:41 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:11:41 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:11:41 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:11:41 user nova-compute[76815]:   </cpu>
Nov 14 22:11:41 user nova-compute[76815]:   <devices>
Nov 14 22:11:41 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:11:41 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:11:41 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk"/>
Nov 14 22:11:41 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:11:41 user nova-compute[76815]:     </disk>
Nov 14 22:11:41 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:11:41 user nova-compute[76815]:       <mac address="fa:16:3e:21:d0:fd"/>
Nov 14 22:11:41 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:11:41 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:11:41 user nova-compute[76815]:       <target dev="tapdc5e49f0-2f"/>
Nov 14 22:11:41 user nova-compute[76815]:     </interface>
Nov 14 22:11:41 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:11:41 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/console.log" append="off"/>
Nov 14 22:11:41 user nova-compute[76815]:     </serial>
Nov 14 22:11:41 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:11:41 user nova-compute[76815]:     <video>
Nov 14 22:11:41 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:11:41 user nova-compute[76815]:     </video>
Nov 14 22:11:41 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:11:41 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:11:41 user nova-compute[76815]:     </rng>
Nov 14 22:11:41 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:11:41 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:11:41 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:11:41 user nova-compute[76815]:     </memballoon>
Nov 14 22:11:41 user nova-compute[76815]:   </devices>
Nov 14 22:11:41 user nova-compute[76815]: </domain>
Nov 14 22:11:41 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1093783850',display_name='tempest-ServerActionsTestOtherA-server-1093783850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1093783850',id=15,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVfME04PD9rglznppi8Ho3+jsumiOYFPtvR+yy+S2ej5C5M3kJOl8pyG4taHWLiqRqGcIU6SfKKWEu+JVsdH1FsdhxYcOosylxiuo+4fsZkdlqozg87LpEdVgLP6QXNw==',key_name='tempest-keypair-1998197341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-kbmqf7bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=065c90e1-2099-4446-a998-de681bedf500,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:d0:fd,bridge_name='br-int',has_traffic_filtering=True,id=dc5e49f0-2f7c-4750-86ab-270834c97d82,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5e49f0-2f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG os_vif [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d0:fd,bridge_name='br-int',has_traffic_filtering=True,id=dc5e49f0-2f7c-4750-86ab-270834c97d82,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5e49f0-2f') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a99f710-00ab-54b2-8432-139c6a1116b9', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc5e49f0-2f, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc5e49f0-2f, col_values=(('qos', UUID('35ef02cc-48a0-4f24-aafb-f05c84f49029')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc5e49f0-2f, col_values=(('external_ids', {'iface-id': 'dc5e49f0-2f7c-4750-86ab-270834c97d82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:d0:fd', 'vm-uuid': '065c90e1-2099-4446-a998-de681bedf500'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: INFO os_vif [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:d0:fd,bridge_name='br-int',has_traffic_filtering=True,id=dc5e49f0-2f7c-4750-86ab-270834c97d82,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5e49f0-2f')
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "16c58923-c97e-4148-af31-9609b9af5d80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:41 user nova-compute[76815]: INFO nova.compute.manager [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Terminating instance
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No VIF found with MAC fa:16:3e:21:d0:fd, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Instance spawned successfully.
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:41 user nova-compute[76815]: INFO nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Took 6.06 seconds to spawn the instance on the hypervisor.
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.network.neutron [req-e43c697e-26dc-481f-bbd4-59520950d0c9 req-6eda51fd-8f4e-410a-87f7-54dd0d44dbde service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updated VIF entry in instance network info cache for port dc5e49f0-2f7c-4750-86ab-270834c97d82. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG nova.network.neutron [req-e43c697e-26dc-481f-bbd4-59520950d0c9 req-6eda51fd-8f4e-410a-87f7-54dd0d44dbde service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updating instance_info_cache with network_info: [{"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e43c697e-26dc-481f-bbd4-59520950d0c9 req-6eda51fd-8f4e-410a-87f7-54dd0d44dbde service nova] Releasing lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:11:41 user nova-compute[76815]: INFO nova.compute.manager [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Took 6.82 seconds to build instance.
Nov 14 22:11:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-57ce6616-9caf-4688-b36f-7cf193c07843 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.922s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Instance destroyed successfully.
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.objects.instance [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lazy-loading 'resources' on Instance uuid 16c58923-c97e-4148-af31-9609b9af5d80 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1997585454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-195882950',id=5,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYdEPXMAY/BvZ90CFnDjbrUDJXhggicS+WTg8lo2jdxV4Oxwqif3KxZzm7Zj/wEOoKk76K9c60Oj4htrIR82n8KAEFJjDSxue+s6ZxqtfvL8qnYb+moLbO3gRh8JV6Bug==',key_name='tempest-keypair-958525764',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:10:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a73af2afa50e415d85402bbea4bb143a',ramdisk_id='',reservation_id='r-rwperlky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-310072271',owner_user_name='tempest-ServerActionsV293TestJSON-310072271-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:10:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51594092be7f40638e43426bf32e5290',uuid=16c58923-c97e-4148-af31-9609b9af5d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converting VIF {"id": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "address": "fa:16:3e:3f:b3:fb", "network": {"id": "25f23dae-f093-4455-971f-c2d35ed2cead", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-420646868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a73af2afa50e415d85402bbea4bb143a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46306924-6e", "ovs_interfaceid": "46306924-6ee9-480c-87a9-6a4a86acaa7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_vif [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46306924-6e, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received event network-vif-plugged-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] Acquiring lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] No waiting events found dispatching network-vif-plugged-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:43 user nova-compute[76815]: WARNING nova.compute.manager [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received unexpected event network-vif-plugged-2c08b739-bf8a-4e86-ae64-9afa96802414 for instance with vm_state active and task_state None.
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-unplugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] No waiting events found dispatching network-vif-unplugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-unplugged-46306924-6ee9-480c-87a9-6a4a86acaa7e for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] Acquiring lock "16c58923-c97e-4148-af31-9609b9af5d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] Lock "16c58923-c97e-4148-af31-9609b9af5d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] No waiting events found dispatching network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:43 user nova-compute[76815]: WARNING nova.compute.manager [req-18b9ef73-04c0-4286-9173-2a8d54a377de req-48eadb91-1251-4ec3-8a0d-4e219cb02f6c service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received unexpected event network-vif-plugged-46306924-6ee9-480c-87a9-6a4a86acaa7e for instance with vm_state active and task_state deleting.
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42b1424d-86ad-4d5a-b4df-df4ac59e3c37) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: INFO os_vif [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:b3:fb,bridge_name='br-int',has_traffic_filtering=True,id=46306924-6ee9-480c-87a9-6a4a86acaa7e,network=Network(25f23dae-f093-4455-971f-c2d35ed2cead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46306924-6e')
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HNAXDfGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:11:43 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[955598b7-e346-49db-8b8a-3f4bf5589a3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:11:43 user nova-compute[76815]: No targets found.
Nov 14 22:11:43 user nova-compute[76815]: iSNS:
Nov 14 22:11:43 user nova-compute[76815]: No targets found.
Nov 14 22:11:43 user nova-compute[76815]: STATIC:
Nov 14 22:11:43 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343
Nov 14 22:11:43 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:11:43 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:11:43 user nova-compute[76815]: FIRMWARE:
Nov 14 22:11:43 user nova-compute[76815]: No targets found.
Nov 14 22:11:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:11:43 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:11:43 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[235e5983-503b-4bad-a1e6-aa98ef3186c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bc49c2-1853-43a9-b06d-1e9970bf7b5b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:11:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 (non-flash)
Nov 14 22:11:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a451f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343'): ({'sdk'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Removing single pathed devices sdk {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[137a6310-9256-4c32-92a5-5109e2738d10]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd7a746-952b-4c48-9d3d-764876a95504]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Flushing IO for device /dev/sdk {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde49aeb-1fac-40e1-a269-c468e4f0ff05]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[487a4ece-016c-48a6-8b63-23aa524b4d39]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] SCSI volumes sdk have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b40fd13-490b-4005-a88a-022231a47529]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e58789e-0267-43f0-9a48-8c20dcc8fb62]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260]
Nov 14 22:11:43 user nova-compute[76815]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343, portal: 172.16.0.220,3260] successful.
Nov 14 22:11:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af26b3f-5a82-494f-bc15-a56c69a490b1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] <== disconnect_volume: return (384ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:11:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Deleting instance files /opt/stack/data/nova/instances/16c58923-c97e-4148-af31-9609b9af5d80_del
Nov 14 22:11:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Deletion of /opt/stack/data/nova/instances/16c58923-c97e-4148-af31-9609b9af5d80_del complete
Nov 14 22:11:43 user nova-compute[76815]: INFO nova.compute.manager [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Took 2.25 seconds to destroy the instance on the hypervisor.
Nov 14 22:11:43 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:44 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:44 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Took 0.79 seconds to deallocate network for instance.
Nov 14 22:11:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-7d1a7f95-079b-4157-97cf-fb6cc69217d8 req-b3a47e21-bbe7-4fb4-9429-dee0ee8cca3e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Received event network-vif-deleted-46306924-6ee9-480c-87a9-6a4a86acaa7e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:44 user nova-compute[76815]: INFO nova.compute.manager [req-7d1a7f95-079b-4157-97cf-fb6cc69217d8 req-b3a47e21-bbe7-4fb4-9429-dee0ee8cca3e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Neutron deleted interface 46306924-6ee9-480c-87a9-6a4a86acaa7e; detaching it from the instance and deleting it from the info cache
Nov 14 22:11:44 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d1a7f95-079b-4157-97cf-fb6cc69217d8 req-b3a47e21-bbe7-4fb4-9429-dee0ee8cca3e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:11:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-7d1a7f95-079b-4157-97cf-fb6cc69217d8 req-b3a47e21-bbe7-4fb4-9429-dee0ee8cca3e service nova] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Detach interface failed, port_id=46306924-6ee9-480c-87a9-6a4a86acaa7e, reason: Instance 16c58923-c97e-4148-af31-9609b9af5d80 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received event network-vif-plugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] Acquiring lock "065c90e1-2099-4446-a998-de681bedf500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] Lock "065c90e1-2099-4446-a998-de681bedf500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] Lock "065c90e1-2099-4446-a998-de681bedf500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] No waiting events found dispatching network-vif-plugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:45 user nova-compute[76815]: WARNING nova.compute.manager [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received unexpected event network-vif-plugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 for instance with vm_state building and task_state spawning.
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received event network-vif-plugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] Acquiring lock "065c90e1-2099-4446-a998-de681bedf500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] Lock "065c90e1-2099-4446-a998-de681bedf500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] Lock "065c90e1-2099-4446-a998-de681bedf500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] No waiting events found dispatching network-vif-plugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:45 user nova-compute[76815]: WARNING nova.compute.manager [req-048749a6-4a1f-4a57-8b51-d1a41468d3af req-0270584e-44fb-4fc8-9c36-4c1db6b4fdb6 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received unexpected event network-vif-plugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 for instance with vm_state building and task_state spawning.
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:11:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 065c90e1-2099-4446-a998-de681bedf500] Instance spawned successfully.
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:11:45 user nova-compute[76815]: INFO nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 14 22:11:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:11:45 user nova-compute[76815]: INFO nova.compute.manager [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Took 7.14 seconds to build instance.
Nov 14 22:11:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4efa859e-7fc2-4990-acd9-ce1ab0b7638b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "065c90e1-2099-4446-a998-de681bedf500" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.233s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:47 user nova-compute[76815]: INFO nova.compute.manager [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Took 2.82 seconds to detach 1 volumes for instance.
Nov 14 22:11:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] [instance: 16c58923-c97e-4148-af31-9609b9af5d80] Deleting volume: 0ddc9d17-eda6-4c6d-96e2-2179bc7fd343 {{(pid=76815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Starting finish_migration {{(pid=76815) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance directory exists: not creating {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 22:11:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Creating image(s)
Nov 14 22:11:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:47 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Deleted allocations for instance 16c58923-c97e-4148-af31-9609b9af5d80
Nov 14 22:11:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.215s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk. size=21474836480 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9892dff8-3723-4d4d-b4ed-3763de0fb909 tempest-ServerActionsV293TestJSON-310072271 tempest-ServerActionsV293TestJSON-310072271-project-member] Lock "16c58923-c97e-4148-af31-9609b9af5d80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.580s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk 21474836480 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk 21474836480" returned: 0 in 0.046s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Ensure instance console log exists: /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Start _get_guest_xml network_info=[{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1630974441-network", "vif_mac": "fa:16:3e:33:73:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2a7d6b8f-698f-4e0b-a28e-131121d8fe8a', 'attached_at': '2023-11-14T22:11:47.000000', 'detached_at': '', 'volume_id': '925a86c5-4658-4b61-9360-7b14b96cfe4f', 'serial': '925a86c5-4658-4b61-9360-7b14b96cfe4f'}, 'attachment_id': '35dc462a-2f78-4bc2-8845-f3c29e0ead45', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:48 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:11:48 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:11:48 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:11:48 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:11:48 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[881dbddc-d32c-477e-8b27-00653054cba2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:11:48 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf08fa9-44ab-47ec-910d-0975d3947aa6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f] added
Nov 14 22:11:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9ef02f-22fa-4837-87c6-e86fd12a942d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba43a6e-728d-4587-afde-ce18be4d20a1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v doZtJFaw {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v doZtJFaw" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[16617afd-b5aa-4d47-8bd2-8a139ab46964]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'doZtJFaw'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9173d8e4-1e00-4db7-b216-3a6e9ec0961a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[472017d6-7eee-4a21-8c2d-123e9ed1b921]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:11:48 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:11:48 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:11:48 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:11:48 user nova-compute[76815]: 
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a2eac7-a4ba-43c3-ac8b-ee81feaf6397]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]
Nov 14 22:11:48 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.
Nov 14 22:11:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcee694-5a54-4a92-930a-9a526518506b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3249203-4dc2-4280-86e1-3669edc075d0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:11:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:11:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[626ab95d-6d9f-4c09-a1b3-ac315bbc1f2f]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:11:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23037666264373761', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037666264373761', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-740046946',display_name='tempest-ServerActionsTestOtherB-server-740046946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-740046946',id=2,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfyvibJFZ3+P9cPClSwRvADUm92jfJ8o6BTO5uqmymmHB851px3NqgPd2QQeHEC+IldkPYJsk/5QKXvtU1Q/t5lYj1GQkm68rGyQFBVBYEDC0MsPp+SZUuhpQDRtsF5Yw==',key_name='tempest-keypair-689678311',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3021ff6fd9ad4958a9907c1b75f89a56',ramdisk_id='',reservation_id='r-uw1mr160',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-614422799',owner_user_name='tempest-ServerActionsTestOtherB-614422799-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:11:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82120460b2945879455016ed97cafe9',uuid=2a7d6b8f-698f-4e0b-a28e-131121d8fe8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1630974441-network", "vif_mac": "fa:16:3e:33:73:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converting VIF {"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1630974441-network", "vif_mac": "fa:16:3e:33:73:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:11:49 user nova-compute[76815]:   <uuid>2a7d6b8f-698f-4e0b-a28e-131121d8fe8a</uuid>
Nov 14 22:11:49 user nova-compute[76815]:   <name>instance-00000002</name>
Nov 14 22:11:49 user nova-compute[76815]:   <memory>2097152</memory>
Nov 14 22:11:49 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:11:49 user nova-compute[76815]:   <metadata>
Nov 14 22:11:49 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:11:49 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:11:49 user nova-compute[76815]:       <nova:name>tempest-ServerActionsTestOtherB-server-740046946</nova:name>
Nov 14 22:11:49 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:11:48</nova:creationTime>
Nov 14 22:11:49 user nova-compute[76815]:       <nova:flavor name="m1.small">
Nov 14 22:11:49 user nova-compute[76815]:         <nova:memory>2048</nova:memory>
Nov 14 22:11:49 user nova-compute[76815]:         <nova:disk>20</nova:disk>
Nov 14 22:11:49 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:11:49 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:11:49 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:11:49 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:11:49 user nova-compute[76815]:       <nova:owner>
Nov 14 22:11:49 user nova-compute[76815]:         <nova:user uuid="c82120460b2945879455016ed97cafe9">tempest-ServerActionsTestOtherB-614422799-project-member</nova:user>
Nov 14 22:11:49 user nova-compute[76815]:         <nova:project uuid="3021ff6fd9ad4958a9907c1b75f89a56">tempest-ServerActionsTestOtherB-614422799</nova:project>
Nov 14 22:11:49 user nova-compute[76815]:       </nova:owner>
Nov 14 22:11:49 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:11:49 user nova-compute[76815]:       <nova:ports>
Nov 14 22:11:49 user nova-compute[76815]:         <nova:port uuid="01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae">
Nov 14 22:11:49 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 22:11:49 user nova-compute[76815]:         </nova:port>
Nov 14 22:11:49 user nova-compute[76815]:       </nova:ports>
Nov 14 22:11:49 user nova-compute[76815]:     </nova:instance>
Nov 14 22:11:49 user nova-compute[76815]:   </metadata>
Nov 14 22:11:49 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:11:49 user nova-compute[76815]:     <system>
Nov 14 22:11:49 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:11:49 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:11:49 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:11:49 user nova-compute[76815]:       <entry name="serial">2a7d6b8f-698f-4e0b-a28e-131121d8fe8a</entry>
Nov 14 22:11:49 user nova-compute[76815]:       <entry name="uuid">2a7d6b8f-698f-4e0b-a28e-131121d8fe8a</entry>
Nov 14 22:11:49 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:11:49 user nova-compute[76815]:     </system>
Nov 14 22:11:49 user nova-compute[76815]:   </sysinfo>
Nov 14 22:11:49 user nova-compute[76815]:   <os>
Nov 14 22:11:49 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:11:49 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:11:49 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:11:49 user nova-compute[76815]:   </os>
Nov 14 22:11:49 user nova-compute[76815]:   <features>
Nov 14 22:11:49 user nova-compute[76815]:     <acpi/>
Nov 14 22:11:49 user nova-compute[76815]:     <apic/>
Nov 14 22:11:49 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:11:49 user nova-compute[76815]:   </features>
Nov 14 22:11:49 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:11:49 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:11:49 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:11:49 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:11:49 user nova-compute[76815]:   </clock>
Nov 14 22:11:49 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:11:49 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:11:49 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:11:49 user nova-compute[76815]:   </cpu>
Nov 14 22:11:49 user nova-compute[76815]:   <devices>
Nov 14 22:11:49 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:11:49 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:11:49 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk"/>
Nov 14 22:11:49 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:11:49 user nova-compute[76815]:     </disk>
Nov 14 22:11:49 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:11:49 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:11:49 user nova-compute[76815]:       <source dev="/dev/sdb"/>
Nov 14 22:11:49 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:11:49 user nova-compute[76815]:       <serial>925a86c5-4658-4b61-9360-7b14b96cfe4f</serial>
Nov 14 22:11:49 user nova-compute[76815]:     </disk>
Nov 14 22:11:49 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:11:49 user nova-compute[76815]:       <mac address="fa:16:3e:33:73:f8"/>
Nov 14 22:11:49 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:11:49 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:11:49 user nova-compute[76815]:       <target dev="tap01b0d4dc-1d"/>
Nov 14 22:11:49 user nova-compute[76815]:     </interface>
Nov 14 22:11:49 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:11:49 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/console.log" append="off"/>
Nov 14 22:11:49 user nova-compute[76815]:     </serial>
Nov 14 22:11:49 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:11:49 user nova-compute[76815]:     <video>
Nov 14 22:11:49 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:11:49 user nova-compute[76815]:     </video>
Nov 14 22:11:49 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:11:49 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:11:49 user nova-compute[76815]:     </rng>
Nov 14 22:11:49 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:11:49 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:11:49 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:11:49 user nova-compute[76815]:     </memballoon>
Nov 14 22:11:49 user nova-compute[76815]:   </devices>
Nov 14 22:11:49 user nova-compute[76815]: </domain>
Nov 14 22:11:49 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-740046946',display_name='tempest-ServerActionsTestOtherB-server-740046946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-740046946',id=2,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfyvibJFZ3+P9cPClSwRvADUm92jfJ8o6BTO5uqmymmHB851px3NqgPd2QQeHEC+IldkPYJsk/5QKXvtU1Q/t5lYj1GQkm68rGyQFBVBYEDC0MsPp+SZUuhpQDRtsF5Yw==',key_name='tempest-keypair-689678311',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3021ff6fd9ad4958a9907c1b75f89a56',ramdisk_id='',reservation_id='r-uw1mr160',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-614422799',owner_user_name='tempest-ServerActionsTestOtherB-614422799-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:11:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82120460b2945879455016ed97cafe9',uuid=2a7d6b8f-698f-4e0b-a28e-131121d8fe8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1630974441-network", "vif_mac": "fa:16:3e:33:73:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converting VIF {"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1630974441-network", "vif_mac": "fa:16:3e:33:73:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG os_vif [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f4db374-c304-5fcf-a542-83069f7f61a7', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b0d4dc-1d, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01b0d4dc-1d, col_values=(('qos', UUID('72d993bc-62ae-47d8-a89a-17b1af391c79')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01b0d4dc-1d, col_values=(('external_ids', {'iface-id': '01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:73:f8', 'vm-uuid': '2a7d6b8f-698f-4e0b-a28e-131121d8fe8a'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:49 user nova-compute[76815]: INFO os_vif [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d')
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:11:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] No VIF found with MAC fa:16:3e:33:73:f8, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-795ca525-c038-415c-92b6-e5b656947495 req-77dddb31-e734-47cd-8e5f-03e8dab8edcb service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-795ca525-c038-415c-92b6-e5b656947495 req-77dddb31-e734-47cd-8e5f-03e8dab8edcb service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-795ca525-c038-415c-92b6-e5b656947495 req-77dddb31-e734-47cd-8e5f-03e8dab8edcb service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-795ca525-c038-415c-92b6-e5b656947495 req-77dddb31-e734-47cd-8e5f-03e8dab8edcb service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-795ca525-c038-415c-92b6-e5b656947495 req-77dddb31-e734-47cd-8e5f-03e8dab8edcb service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:51 user nova-compute[76815]: WARNING nova.compute.manager [req-795ca525-c038-415c-92b6-e5b656947495 req-77dddb31-e734-47cd-8e5f-03e8dab8edcb service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state active and task_state resize_finish.
Nov 14 22:11:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:11:53 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance running successfully.
Nov 14 22:11:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Failed to set time: agent not configured {{(pid=76815) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 22:11:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aee9606-67ee-441e-88f4-76869095bb4e tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] finish_migration finished successfully. {{(pid=76815) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 22:11:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-ac1e3820-9e75-4ebf-8ff8-5d08b82117c3 req-89a43659-8573-4a53-993e-35b4f7f3b1f7 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:11:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ac1e3820-9e75-4ebf-8ff8-5d08b82117c3 req-89a43659-8573-4a53-993e-35b4f7f3b1f7 service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:11:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ac1e3820-9e75-4ebf-8ff8-5d08b82117c3 req-89a43659-8573-4a53-993e-35b4f7f3b1f7 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:11:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ac1e3820-9e75-4ebf-8ff8-5d08b82117c3 req-89a43659-8573-4a53-993e-35b4f7f3b1f7 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:11:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-ac1e3820-9e75-4ebf-8ff8-5d08b82117c3 req-89a43659-8573-4a53-993e-35b4f7f3b1f7 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:11:53 user nova-compute[76815]: WARNING nova.compute.manager [req-ac1e3820-9e75-4ebf-8ff8-5d08b82117c3 req-89a43659-8573-4a53-993e-35b4f7f3b1f7 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state active and task_state resize_finish.
Nov 14 22:11:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:11:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "0d55b663-e682-4d03-a613-a8895e301200" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "0d55b663-e682-4d03-a613-a8895e301200" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:12:03 user nova-compute[76815]: INFO nova.compute.claims [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Claim successful on node user
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:12:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:12:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Creating image(s)
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "/opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "/opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG nova.policy [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b7935d9b21649d6a22c6b8700fbee4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c9996c7ec44bdf912e9dfc6cd852a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk 1073741824" returned: 0 in 0.134s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Cannot resize image /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Ensure instance console log exists: /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Successfully created port: 51343da9-091a-4e9e-9aaa-5d358b2943df {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Successfully updated port: 51343da9-091a-4e9e-9aaa-5d358b2943df {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "refresh_cache-0d55b663-e682-4d03-a613-a8895e301200" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquired lock "refresh_cache-0d55b663-e682-4d03-a613-a8895e301200" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-0b1908c6-9c96-485e-a0fa-d45ad28baa7f req-4e1adcb6-1318-45cd-8215-9e9f3a8bac57 service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Received event network-changed-51343da9-091a-4e9e-9aaa-5d358b2943df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-0b1908c6-9c96-485e-a0fa-d45ad28baa7f req-4e1adcb6-1318-45cd-8215-9e9f3a8bac57 service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Refreshing instance network info cache due to event network-changed-51343da9-091a-4e9e-9aaa-5d358b2943df. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0b1908c6-9c96-485e-a0fa-d45ad28baa7f req-4e1adcb6-1318-45cd-8215-9e9f3a8bac57 service nova] Acquiring lock "refresh_cache-0d55b663-e682-4d03-a613-a8895e301200" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Updating instance_info_cache with network_info: [{"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Releasing lock "refresh_cache-0d55b663-e682-4d03-a613-a8895e301200" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Instance network_info: |[{"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0b1908c6-9c96-485e-a0fa-d45ad28baa7f req-4e1adcb6-1318-45cd-8215-9e9f3a8bac57 service nova] Acquired lock "refresh_cache-0d55b663-e682-4d03-a613-a8895e301200" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.network.neutron [req-0b1908c6-9c96-485e-a0fa-d45ad28baa7f req-4e1adcb6-1318-45cd-8215-9e9f3a8bac57 service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Refreshing network info cache for port 51343da9-091a-4e9e-9aaa-5d358b2943df {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Start _get_guest_xml network_info=[{"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:12:05 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:12:05 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-67071073',display_name='tempest-VolumesActionsTest-instance-67071073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-67071073',id=16,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9c9996c7ec44bdf912e9dfc6cd852a0',ramdisk_id='',reservation_id='r-zc9fqzah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-439034333',owner_user_name='tempest-VolumesActionsTest-439034333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:12:04Z,user_data=None,user_id='4b7935d9b21649d6a22c6b8700fbee4f',uuid=0d55b663-e682-4d03-a613-a8895e301200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converting VIF {"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:62:c8,bridge_name='br-int',has_traffic_filtering=True,id=51343da9-091a-4e9e-9aaa-5d358b2943df,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51343da9-09') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.objects.instance [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d55b663-e682-4d03-a613-a8895e301200 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:12:05 user nova-compute[76815]:   <uuid>0d55b663-e682-4d03-a613-a8895e301200</uuid>
Nov 14 22:12:05 user nova-compute[76815]:   <name>instance-00000010</name>
Nov 14 22:12:05 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:12:05 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:12:05 user nova-compute[76815]:   <metadata>
Nov 14 22:12:05 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:12:05 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:12:05 user nova-compute[76815]:       <nova:name>tempest-VolumesActionsTest-instance-67071073</nova:name>
Nov 14 22:12:05 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:12:05</nova:creationTime>
Nov 14 22:12:05 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:12:05 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:12:05 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:12:05 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:12:05 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:12:05 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:12:05 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:12:05 user nova-compute[76815]:       <nova:owner>
Nov 14 22:12:05 user nova-compute[76815]:         <nova:user uuid="4b7935d9b21649d6a22c6b8700fbee4f">tempest-VolumesActionsTest-439034333-project-member</nova:user>
Nov 14 22:12:05 user nova-compute[76815]:         <nova:project uuid="c9c9996c7ec44bdf912e9dfc6cd852a0">tempest-VolumesActionsTest-439034333</nova:project>
Nov 14 22:12:05 user nova-compute[76815]:       </nova:owner>
Nov 14 22:12:05 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:12:05 user nova-compute[76815]:       <nova:ports>
Nov 14 22:12:05 user nova-compute[76815]:         <nova:port uuid="51343da9-091a-4e9e-9aaa-5d358b2943df">
Nov 14 22:12:05 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 22:12:05 user nova-compute[76815]:         </nova:port>
Nov 14 22:12:05 user nova-compute[76815]:       </nova:ports>
Nov 14 22:12:05 user nova-compute[76815]:     </nova:instance>
Nov 14 22:12:05 user nova-compute[76815]:   </metadata>
Nov 14 22:12:05 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:12:05 user nova-compute[76815]:     <system>
Nov 14 22:12:05 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:12:05 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:12:05 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:12:05 user nova-compute[76815]:       <entry name="serial">0d55b663-e682-4d03-a613-a8895e301200</entry>
Nov 14 22:12:05 user nova-compute[76815]:       <entry name="uuid">0d55b663-e682-4d03-a613-a8895e301200</entry>
Nov 14 22:12:05 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:12:05 user nova-compute[76815]:     </system>
Nov 14 22:12:05 user nova-compute[76815]:   </sysinfo>
Nov 14 22:12:05 user nova-compute[76815]:   <os>
Nov 14 22:12:05 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:12:05 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:12:05 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:12:05 user nova-compute[76815]:   </os>
Nov 14 22:12:05 user nova-compute[76815]:   <features>
Nov 14 22:12:05 user nova-compute[76815]:     <acpi/>
Nov 14 22:12:05 user nova-compute[76815]:     <apic/>
Nov 14 22:12:05 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:12:05 user nova-compute[76815]:   </features>
Nov 14 22:12:05 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:12:05 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:12:05 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:12:05 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:12:05 user nova-compute[76815]:   </clock>
Nov 14 22:12:05 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:12:05 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:12:05 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:12:05 user nova-compute[76815]:   </cpu>
Nov 14 22:12:05 user nova-compute[76815]:   <devices>
Nov 14 22:12:05 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:12:05 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:12:05 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk"/>
Nov 14 22:12:05 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:12:05 user nova-compute[76815]:     </disk>
Nov 14 22:12:05 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:12:05 user nova-compute[76815]:       <mac address="fa:16:3e:fa:62:c8"/>
Nov 14 22:12:05 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:12:05 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:12:05 user nova-compute[76815]:       <target dev="tap51343da9-09"/>
Nov 14 22:12:05 user nova-compute[76815]:     </interface>
Nov 14 22:12:05 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:12:05 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/console.log" append="off"/>
Nov 14 22:12:05 user nova-compute[76815]:     </serial>
Nov 14 22:12:05 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:12:05 user nova-compute[76815]:     <video>
Nov 14 22:12:05 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:12:05 user nova-compute[76815]:     </video>
Nov 14 22:12:05 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:12:05 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:12:05 user nova-compute[76815]:     </rng>
Nov 14 22:12:05 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:12:05 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:12:05 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:12:05 user nova-compute[76815]:     </memballoon>
Nov 14 22:12:05 user nova-compute[76815]:   </devices>
Nov 14 22:12:05 user nova-compute[76815]: </domain>
Nov 14 22:12:05 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-67071073',display_name='tempest-VolumesActionsTest-instance-67071073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-67071073',id=16,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9c9996c7ec44bdf912e9dfc6cd852a0',ramdisk_id='',reservation_id='r-zc9fqzah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-439034333',owner_user_name='tempest-VolumesActionsTest-439034333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:12:04Z,user_data=None,user_id='4b7935d9b21649d6a22c6b8700fbee4f',uuid=0d55b663-e682-4d03-a613-a8895e301200,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converting VIF {"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:62:c8,bridge_name='br-int',has_traffic_filtering=True,id=51343da9-091a-4e9e-9aaa-5d358b2943df,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51343da9-09') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG os_vif [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:62:c8,bridge_name='br-int',has_traffic_filtering=True,id=51343da9-091a-4e9e-9aaa-5d358b2943df,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51343da9-09') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38c5e291-79ad-5b04-9516-3001854f879e', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51343da9-09, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51343da9-09, col_values=(('qos', UUID('c91fe7d2-0a53-40e6-ba09-24cb9abe3da9')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51343da9-09, col_values=(('external_ids', {'iface-id': '51343da9-091a-4e9e-9aaa-5d358b2943df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:62:c8', 'vm-uuid': '0d55b663-e682-4d03-a613-a8895e301200'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:12:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:05 user nova-compute[76815]: INFO os_vif [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:62:c8,bridge_name='br-int',has_traffic_filtering=True,id=51343da9-091a-4e9e-9aaa-5d358b2943df,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51343da9-09')
Nov 14 22:12:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:12:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] No VIF found with MAC fa:16:3e:fa:62:c8, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:12:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-0b1908c6-9c96-485e-a0fa-d45ad28baa7f req-4e1adcb6-1318-45cd-8215-9e9f3a8bac57 service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Updated VIF entry in instance network info cache for port 51343da9-091a-4e9e-9aaa-5d358b2943df. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:12:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-0b1908c6-9c96-485e-a0fa-d45ad28baa7f req-4e1adcb6-1318-45cd-8215-9e9f3a8bac57 service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Updating instance_info_cache with network_info: [{"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:12:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0b1908c6-9c96-485e-a0fa-d45ad28baa7f req-4e1adcb6-1318-45cd-8215-9e9f3a8bac57 service nova] Releasing lock "refresh_cache-0d55b663-e682-4d03-a613-a8895e301200" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:12:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-3cdf44a0-4626-494d-b07c-e0f20f2a564c req-62e43dd9-0a70-4dcc-a838-d76f1ceb0b8f service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Received event network-vif-plugged-51343da9-091a-4e9e-9aaa-5d358b2943df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:12:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3cdf44a0-4626-494d-b07c-e0f20f2a564c req-62e43dd9-0a70-4dcc-a838-d76f1ceb0b8f service nova] Acquiring lock "0d55b663-e682-4d03-a613-a8895e301200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3cdf44a0-4626-494d-b07c-e0f20f2a564c req-62e43dd9-0a70-4dcc-a838-d76f1ceb0b8f service nova] Lock "0d55b663-e682-4d03-a613-a8895e301200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3cdf44a0-4626-494d-b07c-e0f20f2a564c req-62e43dd9-0a70-4dcc-a838-d76f1ceb0b8f service nova] Lock "0d55b663-e682-4d03-a613-a8895e301200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-3cdf44a0-4626-494d-b07c-e0f20f2a564c req-62e43dd9-0a70-4dcc-a838-d76f1ceb0b8f service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] No waiting events found dispatching network-vif-plugged-51343da9-091a-4e9e-9aaa-5d358b2943df {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:12:07 user nova-compute[76815]: WARNING nova.compute.manager [req-3cdf44a0-4626-494d-b07c-e0f20f2a564c req-62e43dd9-0a70-4dcc-a838-d76f1ceb0b8f service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Received unexpected event network-vif-plugged-51343da9-091a-4e9e-9aaa-5d358b2943df for instance with vm_state building and task_state spawning.
Nov 14 22:12:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:12:09 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Instance spawned successfully.
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-7aff204f-b771-4f1e-9a26-6c910f1a9d21 req-7b803ca1-b352-4004-9734-018ba82e2356 service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Received event network-vif-plugged-51343da9-091a-4e9e-9aaa-5d358b2943df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7aff204f-b771-4f1e-9a26-6c910f1a9d21 req-7b803ca1-b352-4004-9734-018ba82e2356 service nova] Acquiring lock "0d55b663-e682-4d03-a613-a8895e301200-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7aff204f-b771-4f1e-9a26-6c910f1a9d21 req-7b803ca1-b352-4004-9734-018ba82e2356 service nova] Lock "0d55b663-e682-4d03-a613-a8895e301200-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7aff204f-b771-4f1e-9a26-6c910f1a9d21 req-7b803ca1-b352-4004-9734-018ba82e2356 service nova] Lock "0d55b663-e682-4d03-a613-a8895e301200-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-7aff204f-b771-4f1e-9a26-6c910f1a9d21 req-7b803ca1-b352-4004-9734-018ba82e2356 service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] No waiting events found dispatching network-vif-plugged-51343da9-091a-4e9e-9aaa-5d358b2943df {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:12:09 user nova-compute[76815]: WARNING nova.compute.manager [req-7aff204f-b771-4f1e-9a26-6c910f1a9d21 req-7b803ca1-b352-4004-9734-018ba82e2356 service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Received unexpected event network-vif-plugged-51343da9-091a-4e9e-9aaa-5d358b2943df for instance with vm_state building and task_state spawning.
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:09 user nova-compute[76815]: INFO nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 14 22:12:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:12:09 user nova-compute[76815]: INFO nova.compute.manager [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Took 6.85 seconds to build instance.
Nov 14 22:12:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-241cdeb1-8f38-4a4b-81ca-28497d189f32 tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "0d55b663-e682-4d03-a613-a8895e301200" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.958s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:12:29 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:12:30 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:12:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:34 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:12:34 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7643MB free_disk=25.41659927368164GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Applying migration context for instance 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a as it has an incoming, in-progress migration ff042c3f-3a4f-4cfe-9681-d977ea50d8f9. Migration status is finished {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 22:12:34 user nova-compute[76815]: INFO nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating resource usage from migration ff042c3f-3a4f-4cfe-9681-d977ea50d8f9
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bb235db0-61d3-4e29-9794-b7c181f074d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a4c05bc3-b996-4312-8276-a395c7802a1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Migration ff042c3f-3a4f-4cfe-9681-d977ea50d8f9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0d55b663-e682-4d03-a613-a8895e301200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:12:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:12:35 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:12:35 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:12:35 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:12:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:12:36 user nova-compute[76815]: INFO nova.compute.claims [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Claim successful on node user
Nov 14 22:12:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:12:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:12:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:12:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Creating image(s)
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "/opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "/opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "/opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG nova.policy [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7eef7606b4184821bb5f6da806c94aee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a8ddef6a4594cedb3d53bfa0b42071b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk 1073741824" returned: 0 in 0.055s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Checking if we can resize image /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:12:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:12:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:12:38 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Cannot resize image /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:12:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:12:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Ensure instance console log exists: /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:12:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Successfully created port: d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Successfully updated port: d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "refresh_cache-208d704d-b4a8-4fc6-b218-165448162e8f" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquired lock "refresh_cache-208d704d-b4a8-4fc6-b218-165448162e8f" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-013bb471-02a4-4bb5-a483-d1e9f36e2f9c req-b07210c4-33d8-4e45-8e88-9ace5d2b416e service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received event network-changed-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-013bb471-02a4-4bb5-a483-d1e9f36e2f9c req-b07210c4-33d8-4e45-8e88-9ace5d2b416e service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Refreshing instance network info cache due to event network-changed-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-013bb471-02a4-4bb5-a483-d1e9f36e2f9c req-b07210c4-33d8-4e45-8e88-9ace5d2b416e service nova] Acquiring lock "refresh_cache-208d704d-b4a8-4fc6-b218-165448162e8f" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Updating instance_info_cache with network_info: [{"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Releasing lock "refresh_cache-208d704d-b4a8-4fc6-b218-165448162e8f" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Instance network_info: |[{"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-013bb471-02a4-4bb5-a483-d1e9f36e2f9c req-b07210c4-33d8-4e45-8e88-9ace5d2b416e service nova] Acquired lock "refresh_cache-208d704d-b4a8-4fc6-b218-165448162e8f" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-013bb471-02a4-4bb5-a483-d1e9f36e2f9c req-b07210c4-33d8-4e45-8e88-9ace5d2b416e service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Refreshing network info cache for port d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Start _get_guest_xml network_info=[{"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:12:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:12:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:12:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-406328270',display_name='tempest-DeleteServersTestJSON-server-406328270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-406328270',id=17,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a8ddef6a4594cedb3d53bfa0b42071b',ramdisk_id='',reservation_id='r-psszfzr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-308956267',owner_user_name='tempest-DeleteServersTestJSON-308956267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:12:37Z,user_data=None,user_id='7eef7606b4184821bb5f6da806c94aee',uuid=208d704d-b4a8-4fc6-b218-165448162e8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Converting VIF {"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3,network=Network(8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04ae56c-a0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lazy-loading 'pci_devices' on Instance uuid 208d704d-b4a8-4fc6-b218-165448162e8f {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:12:39 user nova-compute[76815]:   <uuid>208d704d-b4a8-4fc6-b218-165448162e8f</uuid>
Nov 14 22:12:39 user nova-compute[76815]:   <name>instance-00000011</name>
Nov 14 22:12:39 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:12:39 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:12:39 user nova-compute[76815]:   <metadata>
Nov 14 22:12:39 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:12:39 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:12:39 user nova-compute[76815]:       <nova:name>tempest-DeleteServersTestJSON-server-406328270</nova:name>
Nov 14 22:12:39 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:12:39</nova:creationTime>
Nov 14 22:12:39 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:12:39 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:12:39 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:12:39 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:12:39 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:12:39 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:12:39 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:12:39 user nova-compute[76815]:       <nova:owner>
Nov 14 22:12:39 user nova-compute[76815]:         <nova:user uuid="7eef7606b4184821bb5f6da806c94aee">tempest-DeleteServersTestJSON-308956267-project-member</nova:user>
Nov 14 22:12:39 user nova-compute[76815]:         <nova:project uuid="6a8ddef6a4594cedb3d53bfa0b42071b">tempest-DeleteServersTestJSON-308956267</nova:project>
Nov 14 22:12:39 user nova-compute[76815]:       </nova:owner>
Nov 14 22:12:39 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:12:39 user nova-compute[76815]:       <nova:ports>
Nov 14 22:12:39 user nova-compute[76815]:         <nova:port uuid="d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3">
Nov 14 22:12:39 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 22:12:39 user nova-compute[76815]:         </nova:port>
Nov 14 22:12:39 user nova-compute[76815]:       </nova:ports>
Nov 14 22:12:39 user nova-compute[76815]:     </nova:instance>
Nov 14 22:12:39 user nova-compute[76815]:   </metadata>
Nov 14 22:12:39 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:12:39 user nova-compute[76815]:     <system>
Nov 14 22:12:39 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:12:39 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:12:39 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:12:39 user nova-compute[76815]:       <entry name="serial">208d704d-b4a8-4fc6-b218-165448162e8f</entry>
Nov 14 22:12:39 user nova-compute[76815]:       <entry name="uuid">208d704d-b4a8-4fc6-b218-165448162e8f</entry>
Nov 14 22:12:39 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:12:39 user nova-compute[76815]:     </system>
Nov 14 22:12:39 user nova-compute[76815]:   </sysinfo>
Nov 14 22:12:39 user nova-compute[76815]:   <os>
Nov 14 22:12:39 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:12:39 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:12:39 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:12:39 user nova-compute[76815]:   </os>
Nov 14 22:12:39 user nova-compute[76815]:   <features>
Nov 14 22:12:39 user nova-compute[76815]:     <acpi/>
Nov 14 22:12:39 user nova-compute[76815]:     <apic/>
Nov 14 22:12:39 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:12:39 user nova-compute[76815]:   </features>
Nov 14 22:12:39 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:12:39 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:12:39 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:12:39 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:12:39 user nova-compute[76815]:   </clock>
Nov 14 22:12:39 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:12:39 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:12:39 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:12:39 user nova-compute[76815]:   </cpu>
Nov 14 22:12:39 user nova-compute[76815]:   <devices>
Nov 14 22:12:39 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:12:39 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:12:39 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk"/>
Nov 14 22:12:39 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:12:39 user nova-compute[76815]:     </disk>
Nov 14 22:12:39 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:12:39 user nova-compute[76815]:       <mac address="fa:16:3e:01:e8:10"/>
Nov 14 22:12:39 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:12:39 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:12:39 user nova-compute[76815]:       <target dev="tapd04ae56c-a0"/>
Nov 14 22:12:39 user nova-compute[76815]:     </interface>
Nov 14 22:12:39 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:12:39 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/console.log" append="off"/>
Nov 14 22:12:39 user nova-compute[76815]:     </serial>
Nov 14 22:12:39 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:12:39 user nova-compute[76815]:     <video>
Nov 14 22:12:39 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:12:39 user nova-compute[76815]:     </video>
Nov 14 22:12:39 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:12:39 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:12:39 user nova-compute[76815]:     </rng>
Nov 14 22:12:39 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:12:39 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:12:39 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:12:39 user nova-compute[76815]:     </memballoon>
Nov 14 22:12:39 user nova-compute[76815]:   </devices>
Nov 14 22:12:39 user nova-compute[76815]: </domain>
Nov 14 22:12:39 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:12:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-406328270',display_name='tempest-DeleteServersTestJSON-server-406328270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-406328270',id=17,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a8ddef6a4594cedb3d53bfa0b42071b',ramdisk_id='',reservation_id='r-psszfzr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-308956267',owner_user_name='tempest-DeleteServersTestJSON-308956267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:12:37Z,user_data=None,user_id='7eef7606b4184821bb5f6da806c94aee',uuid=208d704d-b4a8-4fc6-b218-165448162e8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Converting VIF {"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3,network=Network(8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04ae56c-a0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG os_vif [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3,network=Network(8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04ae56c-a0') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2acb90a7-0f6e-5d89-a9fb-4e8ab96c8c33', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd04ae56c-a0, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd04ae56c-a0, col_values=(('qos', UUID('22bc08a6-2c79-499a-b839-149805bb09f5')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd04ae56c-a0, col_values=(('external_ids', {'iface-id': 'd04ae56c-a070-4b4d-bcf7-ea9c4cc153f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:e8:10', 'vm-uuid': '208d704d-b4a8-4fc6-b218-165448162e8f'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:39 user nova-compute[76815]: INFO os_vif [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3,network=Network(8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04ae56c-a0')
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] No VIF found with MAC fa:16:3e:01:e8:10, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "a4c05bc3-b996-4312-8276-a395c7802a1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:39 user nova-compute[76815]: INFO nova.compute.manager [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Terminating instance
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-013bb471-02a4-4bb5-a483-d1e9f36e2f9c req-b07210c4-33d8-4e45-8e88-9ace5d2b416e service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Updated VIF entry in instance network info cache for port d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-013bb471-02a4-4bb5-a483-d1e9f36e2f9c req-b07210c4-33d8-4e45-8e88-9ace5d2b416e service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Updating instance_info_cache with network_info: [{"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-013bb471-02a4-4bb5-a483-d1e9f36e2f9c req-b07210c4-33d8-4e45-8e88-9ace5d2b416e service nova] Releasing lock "refresh_cache-208d704d-b4a8-4fc6-b218-165448162e8f" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Instance destroyed successfully.
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lazy-loading 'resources' on Instance uuid a4c05bc3-b996-4312-8276-a395c7802a1c {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-818944814',display_name='tempest-VolumesAdminNegativeTest-server-818944814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-818944814',id=13,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:10:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acd89e0ce8ea4637b1f83034d9264bf6',ramdisk_id='',reservation_id='r-tgasajq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-77219795',owner_user_name='tempest-VolumesAdminNegativeTest-77219795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:10:51Z,user_data=None,user_id='187becfe77604b6d9b4d7f2e8826631d',uuid=a4c05bc3-b996-4312-8276-a395c7802a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converting VIF {"id": "3f031d08-6ef5-4e41-b799-162aad3aa986", "address": "fa:16:3e:57:2d:8c", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f031d08-6e", "ovs_interfaceid": "3f031d08-6ef5-4e41-b799-162aad3aa986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:2d:8c,bridge_name='br-int',has_traffic_filtering=True,id=3f031d08-6ef5-4e41-b799-162aad3aa986,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f031d08-6e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG os_vif [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:2d:8c,bridge_name='br-int',has_traffic_filtering=True,id=3f031d08-6ef5-4e41-b799-162aad3aa986,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f031d08-6e') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f031d08-6e, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=765d7434-2be0-4a2d-9ecf-bd2f8f19a21c) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received event network-vif-unplugged-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] Acquiring lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] No waiting events found dispatching network-vif-unplugged-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received event network-vif-unplugged-3f031d08-6ef5-4e41-b799-162aad3aa986 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received event network-vif-plugged-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] Acquiring lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] No waiting events found dispatching network-vif-plugged-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:12:41 user nova-compute[76815]: WARNING nova.compute.manager [req-ad18cb46-6c84-44e9-9be3-3d55e57e967d req-75338e50-3eb4-4524-928e-ad3aa28236a8 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received unexpected event network-vif-plugged-3f031d08-6ef5-4e41-b799-162aad3aa986 for instance with vm_state active and task_state deleting.
Nov 14 22:12:41 user nova-compute[76815]: INFO os_vif [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:2d:8c,bridge_name='br-int',has_traffic_filtering=True,id=3f031d08-6ef5-4e41-b799-162aad3aa986,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f031d08-6e')
Nov 14 22:12:41 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Deleting instance files /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c_del
Nov 14 22:12:41 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Deletion of /opt/stack/data/nova/instances/a4c05bc3-b996-4312-8276-a395c7802a1c_del complete
Nov 14 22:12:41 user nova-compute[76815]: INFO nova.compute.manager [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-343e00dd-464a-447f-b291-bd8e46032938 req-be421983-9a08-4cb3-85bc-a94b0db911f7 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received event network-vif-plugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-343e00dd-464a-447f-b291-bd8e46032938 req-be421983-9a08-4cb3-85bc-a94b0db911f7 service nova] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-343e00dd-464a-447f-b291-bd8e46032938 req-be421983-9a08-4cb3-85bc-a94b0db911f7 service nova] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-343e00dd-464a-447f-b291-bd8e46032938 req-be421983-9a08-4cb3-85bc-a94b0db911f7 service nova] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-343e00dd-464a-447f-b291-bd8e46032938 req-be421983-9a08-4cb3-85bc-a94b0db911f7 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] No waiting events found dispatching network-vif-plugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:12:41 user nova-compute[76815]: WARNING nova.compute.manager [req-343e00dd-464a-447f-b291-bd8e46032938 req-be421983-9a08-4cb3-85bc-a94b0db911f7 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received unexpected event network-vif-plugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 for instance with vm_state building and task_state spawning.
Nov 14 22:12:41 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:12:41 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Took 0.71 seconds to deallocate network for instance.
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:42 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:12:42 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:12:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:42 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Deleted allocations for instance a4c05bc3-b996-4312-8276-a395c7802a1c
Nov 14 22:12:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a5e6b41-773e-4844-99f3-c3477a131fc2 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a4c05bc3-b996-4312-8276-a395c7802a1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-37bc54d0-2a15-410a-accb-7a5b09877fb0 req-6d0a3618-e49a-444d-b373-83afe5cb9462 service nova] [instance: a4c05bc3-b996-4312-8276-a395c7802a1c] Received event network-vif-deleted-3f031d08-6ef5-4e41-b799-162aad3aa986 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:12:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Instance spawned successfully.
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:12:43 user nova-compute[76815]: INFO nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 14 22:12:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:12:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-f07e8d0c-1569-4b90-869d-3248731cadb3 req-c5df0494-9b18-41af-9871-d9b264140004 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received event network-vif-plugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:12:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f07e8d0c-1569-4b90-869d-3248731cadb3 req-c5df0494-9b18-41af-9871-d9b264140004 service nova] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:12:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f07e8d0c-1569-4b90-869d-3248731cadb3 req-c5df0494-9b18-41af-9871-d9b264140004 service nova] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:12:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f07e8d0c-1569-4b90-869d-3248731cadb3 req-c5df0494-9b18-41af-9871-d9b264140004 service nova] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-f07e8d0c-1569-4b90-869d-3248731cadb3 req-c5df0494-9b18-41af-9871-d9b264140004 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] No waiting events found dispatching network-vif-plugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:12:44 user nova-compute[76815]: WARNING nova.compute.manager [req-f07e8d0c-1569-4b90-869d-3248731cadb3 req-c5df0494-9b18-41af-9871-d9b264140004 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received unexpected event network-vif-plugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 for instance with vm_state building and task_state spawning.
Nov 14 22:12:44 user nova-compute[76815]: INFO nova.compute.manager [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Took 7.60 seconds to build instance.
Nov 14 22:12:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4f63698-fca3-4005-826d-9cfdb6fd9e34 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.713s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:12:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:12:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:13:04 user nova-compute[76815]: INFO nova.compute.claims [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Claim successful on node user
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:13:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.policy [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a7d3c7ad83543cbafc5e5ebcc2e7a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202f1749bf684dbfa082a1bf1eee2b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:13:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Creating image(s)
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "/opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "/opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk 1073741824" returned: 0 in 0.056s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.226s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Cannot resize image /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Ensure instance console log exists: /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Successfully created port: 6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Successfully updated port: 6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquired lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-2e45c7d8-84fa-4e45-83a1-228b671fb1e9 req-17b867ea-64f7-4bad-b9d6-bee67b2d7deb service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received event network-changed-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-2e45c7d8-84fa-4e45-83a1-228b671fb1e9 req-17b867ea-64f7-4bad-b9d6-bee67b2d7deb service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Refreshing instance network info cache due to event network-changed-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:13:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e45c7d8-84fa-4e45-83a1-228b671fb1e9 req-17b867ea-64f7-4bad-b9d6-bee67b2d7deb service nova] Acquiring lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updating instance_info_cache with network_info: [{"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Releasing lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Instance network_info: |[{"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e45c7d8-84fa-4e45-83a1-228b671fb1e9 req-17b867ea-64f7-4bad-b9d6-bee67b2d7deb service nova] Acquired lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.network.neutron [req-2e45c7d8-84fa-4e45-83a1-228b671fb1e9 req-17b867ea-64f7-4bad-b9d6-bee67b2d7deb service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Refreshing network info cache for port 6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Start _get_guest_xml network_info=[{"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:13:07 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:07 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1673265283',display_name='tempest-TestStampPattern-server-1673265283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1673265283',id=18,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIz7adDgP7X73sp1hk5zQagIy7YAy0++VDgbZ8Zj9KPV4CgTwfipeuF7/mA4SwM5VVflsdyyENIt6u4cntTENc7drNh/bLAHBUCOpidpzrADFvxpLgpN2YTtL81gY4jTQ==',key_name='tempest-TestStampPattern-197761174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='202f1749bf684dbfa082a1bf1eee2b2e',ramdisk_id='',reservation_id='r-x7rqdkvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1059321344',owner_user_name='tempest-TestStampPattern-1059321344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:13:05Z,user_data=None,user_id='6a7d3c7ad83543cbafc5e5ebcc2e7a01',uuid=0dc9077f-493b-44b7-bfde-1d448ae001fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converting VIF {"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:e3:01,bridge_name='br-int',has_traffic_filtering=True,id=6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdc63ab-ea') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.objects.instance [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dc9077f-493b-44b7-bfde-1d448ae001fd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:13:07 user nova-compute[76815]:   <uuid>0dc9077f-493b-44b7-bfde-1d448ae001fd</uuid>
Nov 14 22:13:07 user nova-compute[76815]:   <name>instance-00000012</name>
Nov 14 22:13:07 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:13:07 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:13:07 user nova-compute[76815]:   <metadata>
Nov 14 22:13:07 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:13:07 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:13:07 user nova-compute[76815]:       <nova:name>tempest-TestStampPattern-server-1673265283</nova:name>
Nov 14 22:13:07 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:13:07</nova:creationTime>
Nov 14 22:13:07 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:13:07 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:13:07 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:13:07 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:13:07 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:13:07 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:13:07 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:13:07 user nova-compute[76815]:       <nova:owner>
Nov 14 22:13:07 user nova-compute[76815]:         <nova:user uuid="6a7d3c7ad83543cbafc5e5ebcc2e7a01">tempest-TestStampPattern-1059321344-project-member</nova:user>
Nov 14 22:13:07 user nova-compute[76815]:         <nova:project uuid="202f1749bf684dbfa082a1bf1eee2b2e">tempest-TestStampPattern-1059321344</nova:project>
Nov 14 22:13:07 user nova-compute[76815]:       </nova:owner>
Nov 14 22:13:07 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:13:07 user nova-compute[76815]:       <nova:ports>
Nov 14 22:13:07 user nova-compute[76815]:         <nova:port uuid="6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325">
Nov 14 22:13:07 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 22:13:07 user nova-compute[76815]:         </nova:port>
Nov 14 22:13:07 user nova-compute[76815]:       </nova:ports>
Nov 14 22:13:07 user nova-compute[76815]:     </nova:instance>
Nov 14 22:13:07 user nova-compute[76815]:   </metadata>
Nov 14 22:13:07 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:13:07 user nova-compute[76815]:     <system>
Nov 14 22:13:07 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:13:07 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:13:07 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:13:07 user nova-compute[76815]:       <entry name="serial">0dc9077f-493b-44b7-bfde-1d448ae001fd</entry>
Nov 14 22:13:07 user nova-compute[76815]:       <entry name="uuid">0dc9077f-493b-44b7-bfde-1d448ae001fd</entry>
Nov 14 22:13:07 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:13:07 user nova-compute[76815]:     </system>
Nov 14 22:13:07 user nova-compute[76815]:   </sysinfo>
Nov 14 22:13:07 user nova-compute[76815]:   <os>
Nov 14 22:13:07 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:13:07 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:13:07 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:13:07 user nova-compute[76815]:   </os>
Nov 14 22:13:07 user nova-compute[76815]:   <features>
Nov 14 22:13:07 user nova-compute[76815]:     <acpi/>
Nov 14 22:13:07 user nova-compute[76815]:     <apic/>
Nov 14 22:13:07 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:13:07 user nova-compute[76815]:   </features>
Nov 14 22:13:07 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:13:07 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:13:07 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:13:07 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:13:07 user nova-compute[76815]:   </clock>
Nov 14 22:13:07 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:13:07 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:13:07 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:13:07 user nova-compute[76815]:   </cpu>
Nov 14 22:13:07 user nova-compute[76815]:   <devices>
Nov 14 22:13:07 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:13:07 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:13:07 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk"/>
Nov 14 22:13:07 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:13:07 user nova-compute[76815]:     </disk>
Nov 14 22:13:07 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:13:07 user nova-compute[76815]:       <mac address="fa:16:3e:31:e3:01"/>
Nov 14 22:13:07 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:07 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:13:07 user nova-compute[76815]:       <target dev="tap6fdc63ab-ea"/>
Nov 14 22:13:07 user nova-compute[76815]:     </interface>
Nov 14 22:13:07 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:13:07 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/console.log" append="off"/>
Nov 14 22:13:07 user nova-compute[76815]:     </serial>
Nov 14 22:13:07 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:13:07 user nova-compute[76815]:     <video>
Nov 14 22:13:07 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:07 user nova-compute[76815]:     </video>
Nov 14 22:13:07 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:13:07 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:13:07 user nova-compute[76815]:     </rng>
Nov 14 22:13:07 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:13:07 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:13:07 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:13:07 user nova-compute[76815]:     </memballoon>
Nov 14 22:13:07 user nova-compute[76815]:   </devices>
Nov 14 22:13:07 user nova-compute[76815]: </domain>
Nov 14 22:13:07 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1673265283',display_name='tempest-TestStampPattern-server-1673265283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1673265283',id=18,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIz7adDgP7X73sp1hk5zQagIy7YAy0++VDgbZ8Zj9KPV4CgTwfipeuF7/mA4SwM5VVflsdyyENIt6u4cntTENc7drNh/bLAHBUCOpidpzrADFvxpLgpN2YTtL81gY4jTQ==',key_name='tempest-TestStampPattern-197761174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='202f1749bf684dbfa082a1bf1eee2b2e',ramdisk_id='',reservation_id='r-x7rqdkvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1059321344',owner_user_name='tempest-TestStampPattern-1059321344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:13:05Z,user_data=None,user_id='6a7d3c7ad83543cbafc5e5ebcc2e7a01',uuid=0dc9077f-493b-44b7-bfde-1d448ae001fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converting VIF {"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:e3:01,bridge_name='br-int',has_traffic_filtering=True,id=6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdc63ab-ea') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG os_vif [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e3:01,bridge_name='br-int',has_traffic_filtering=True,id=6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdc63ab-ea') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be43dca1-2b02-59e4-9375-04a084427286', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fdc63ab-ea, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fdc63ab-ea, col_values=(('qos', UUID('dfd2a68f-d3b0-4003-8b50-60fdd7f37fc2')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fdc63ab-ea, col_values=(('external_ids', {'iface-id': '6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:e3:01', 'vm-uuid': '0dc9077f-493b-44b7-bfde-1d448ae001fd'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:07 user nova-compute[76815]: INFO os_vif [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e3:01,bridge_name='br-int',has_traffic_filtering=True,id=6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdc63ab-ea')
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No VIF found with MAC fa:16:3e:31:e3:01, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.network.neutron [req-2e45c7d8-84fa-4e45-83a1-228b671fb1e9 req-17b867ea-64f7-4bad-b9d6-bee67b2d7deb service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updated VIF entry in instance network info cache for port 6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG nova.network.neutron [req-2e45c7d8-84fa-4e45-83a1-228b671fb1e9 req-17b867ea-64f7-4bad-b9d6-bee67b2d7deb service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updating instance_info_cache with network_info: [{"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e45c7d8-84fa-4e45-83a1-228b671fb1e9 req-17b867ea-64f7-4bad-b9d6-bee67b2d7deb service nova] Releasing lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-6a5fefa9-898a-48e1-a65d-0b4f5a2558d6 req-827de625-ba28-449e-bebc-05356d85f93c service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received event network-vif-plugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6a5fefa9-898a-48e1-a65d-0b4f5a2558d6 req-827de625-ba28-449e-bebc-05356d85f93c service nova] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6a5fefa9-898a-48e1-a65d-0b4f5a2558d6 req-827de625-ba28-449e-bebc-05356d85f93c service nova] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6a5fefa9-898a-48e1-a65d-0b4f5a2558d6 req-827de625-ba28-449e-bebc-05356d85f93c service nova] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-6a5fefa9-898a-48e1-a65d-0b4f5a2558d6 req-827de625-ba28-449e-bebc-05356d85f93c service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] No waiting events found dispatching network-vif-plugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:10 user nova-compute[76815]: WARNING nova.compute.manager [req-6a5fefa9-898a-48e1-a65d-0b4f5a2558d6 req-827de625-ba28-449e-bebc-05356d85f93c service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received unexpected event network-vif-plugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 for instance with vm_state building and task_state spawning.
Nov 14 22:13:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:13:10 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Instance spawned successfully.
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:11 user nova-compute[76815]: INFO nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 14 22:13:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:13:11 user nova-compute[76815]: INFO nova.compute.manager [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Took 7.07 seconds to build instance.
Nov 14 22:13:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b71e513-b0bd-4e52-87a2-2d3ed50b1985 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.169s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-badb7909-42ad-4c1a-a7d8-70f9b683ca5c req-315dbee0-c3a2-4b2f-add7-4538d9cb8bec service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received event network-vif-plugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-badb7909-42ad-4c1a-a7d8-70f9b683ca5c req-315dbee0-c3a2-4b2f-add7-4538d9cb8bec service nova] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-badb7909-42ad-4c1a-a7d8-70f9b683ca5c req-315dbee0-c3a2-4b2f-add7-4538d9cb8bec service nova] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-badb7909-42ad-4c1a-a7d8-70f9b683ca5c req-315dbee0-c3a2-4b2f-add7-4538d9cb8bec service nova] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-badb7909-42ad-4c1a-a7d8-70f9b683ca5c req-315dbee0-c3a2-4b2f-add7-4538d9cb8bec service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] No waiting events found dispatching network-vif-plugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:12 user nova-compute[76815]: WARNING nova.compute.manager [req-badb7909-42ad-4c1a-a7d8-70f9b683ca5c req-315dbee0-c3a2-4b2f-add7-4538d9cb8bec service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received unexpected event network-vif-plugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 for instance with vm_state active and task_state None.
Nov 14 22:13:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "ce395be4-406e-4968-82c1-915443ebb273" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ce395be4-406e-4968-82c1-915443ebb273" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:16 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:13:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:13:16 user nova-compute[76815]: INFO nova.compute.claims [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Claim successful on node user
Nov 14 22:13:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:16 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:13:16 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:13:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:13:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:13:17 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:13:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:13:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:13:17 user nova-compute[76815]: INFO nova.virt.block_device [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Booting with volume snapshot 10e949c0-581e-494f-8aeb-c2c059887c2b at /dev/vda
Nov 14 22:13:17 user nova-compute[76815]: DEBUG nova.policy [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd5c7c940b0429994db55b93cb421ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673708a9f12541f6929c86eb60ca83c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:13:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:17 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Successfully created port: baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Successfully updated port: baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "refresh_cache-ce395be4-406e-4968-82c1-915443ebb273" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquired lock "refresh_cache-ce395be4-406e-4968-82c1-915443ebb273" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-385d4c2b-5c4c-4877-9881-3dfcad004e25 req-87287a8d-2051-412b-9bbc-f25aac997612 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received event network-changed-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-385d4c2b-5c4c-4877-9881-3dfcad004e25 req-87287a8d-2051-412b-9bbc-f25aac997612 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Refreshing instance network info cache due to event network-changed-baeb019c-0942-4fc5-85bd-1833193e3167. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-385d4c2b-5c4c-4877-9881-3dfcad004e25 req-87287a8d-2051-412b-9bbc-f25aac997612 service nova] Acquiring lock "refresh_cache-ce395be4-406e-4968-82c1-915443ebb273" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Updating instance_info_cache with network_info: [{"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Releasing lock "refresh_cache-ce395be4-406e-4968-82c1-915443ebb273" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Instance network_info: |[{"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-385d4c2b-5c4c-4877-9881-3dfcad004e25 req-87287a8d-2051-412b-9bbc-f25aac997612 service nova] Acquired lock "refresh_cache-ce395be4-406e-4968-82c1-915443ebb273" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:18 user nova-compute[76815]: DEBUG nova.network.neutron [req-385d4c2b-5c4c-4877-9881-3dfcad004e25 req-87287a8d-2051-412b-9bbc-f25aac997612 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Refreshing network info cache for port baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:13:19 user nova-compute[76815]: DEBUG nova.network.neutron [req-385d4c2b-5c4c-4877-9881-3dfcad004e25 req-87287a8d-2051-412b-9bbc-f25aac997612 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Updated VIF entry in instance network info cache for port baeb019c-0942-4fc5-85bd-1833193e3167. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:13:19 user nova-compute[76815]: DEBUG nova.network.neutron [req-385d4c2b-5c4c-4877-9881-3dfcad004e25 req-87287a8d-2051-412b-9bbc-f25aac997612 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Updating instance_info_cache with network_info: [{"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-385d4c2b-5c4c-4877-9881-3dfcad004e25 req-87287a8d-2051-412b-9bbc-f25aac997612 service nova] Releasing lock "refresh_cache-ce395be4-406e-4968-82c1-915443ebb273" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Port 01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae binding to destination host user is already ACTIVE {{(pid=76815) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquired lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG os_brick.utils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5ce315-23ac-4541-9887-77c5a5503772]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb877952-9970-40f5-897d-c6715561bd16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Releasing lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[11839496-1f17-4791-8104-5d9eef773d6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1f31ad-a96e-460d-8d7b-e8a24d9b19fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Creating tmpfile /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/tmprjbyx_ui to verify with other compute node that the instance is on the same shared storage. {{(pid=76815) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:13:22 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:13:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de74c85-0dfb-4e3d-a469-a60f79a00294]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG os_brick.utils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:13:22 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Updating existing volume attachment record: 27a5d7a6-cb96-414f-9230-b03083faacf3 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-87ea841c-c3e7-44f5-b1fd-be535f64c197 req-b745e709-b153-4d98-aeb9-9d660e176ba0 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-87ea841c-c3e7-44f5-b1fd-be535f64c197 req-b745e709-b153-4d98-aeb9-9d660e176ba0 service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-87ea841c-c3e7-44f5-b1fd-be535f64c197 req-b745e709-b153-4d98-aeb9-9d660e176ba0 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-87ea841c-c3e7-44f5-b1fd-be535f64c197 req-b745e709-b153-4d98-aeb9-9d660e176ba0 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-87ea841c-c3e7-44f5-b1fd-be535f64c197 req-b745e709-b153-4d98-aeb9-9d660e176ba0 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:23 user nova-compute[76815]: WARNING nova.compute.manager [req-87ea841c-c3e7-44f5-b1fd-be535f64c197 req-b745e709-b153-4d98-aeb9-9d660e176ba0 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state resized and task_state resize_reverting.
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance destroyed successfully.
Nov 14 22:13:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lazy-loading 'resources' on Instance uuid 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-740046946',display_name='tempest-ServerActionsTestOtherB-server-740046946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-740046946',id=2,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfyvibJFZ3+P9cPClSwRvADUm92jfJ8o6BTO5uqmymmHB851px3NqgPd2QQeHEC+IldkPYJsk/5QKXvtU1Q/t5lYj1GQkm68rGyQFBVBYEDC0MsPp+SZUuhpQDRtsF5Yw==',key_name='tempest-keypair-689678311',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:11:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3021ff6fd9ad4958a9907c1b75f89a56',ramdisk_id='',reservation_id='r-uw1mr160',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-614422799',owner_user_name='tempest-ServerActionsTestOtherB-614422799-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82120460b2945879455016ed97cafe9',uuid=2a7d6b8f-698f-4e0b-a28e-131121d8fe8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converting VIF {"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_vif [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b0d4dc-1d, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72d993bc-62ae-47d8-a89a-17b1af391c79) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:23 user nova-compute[76815]: INFO os_vif [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d')
Nov 14 22:13:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:13:23 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20179a32-de8c-4eff-bac6-8d879b2906e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:13:23 user nova-compute[76815]: No targets found.
Nov 14 22:13:23 user nova-compute[76815]: iSNS:
Nov 14 22:13:23 user nova-compute[76815]: No targets found.
Nov 14 22:13:23 user nova-compute[76815]: STATIC:
Nov 14 22:13:23 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f
Nov 14 22:13:23 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:13:23 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:13:23 user nova-compute[76815]: FIRMWARE:
Nov 14 22:13:23 user nova-compute[76815]: No targets found.
Nov 14 22:13:23 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:13:23 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:13:23 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[217546c0-32a0-450f-9cdc-21002980e03f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[294ad6de-024e-4591-beb0-6d1194f7597a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:13:23 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:13:23 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a43ff490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:13:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5903a1-6705-42bc-b6d6-fc6ec11105a6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa3c565-22ee-4732-a4b6-3112725ac821]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b1fa42-59f9-48bb-b2a5-184f69a77ff6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[614a36f3-6bb7-43da-a05d-ce980c5b49ea]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8976ca8-75a0-4f07-982a-1694e44f0ae3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7c10a1-a97b-45fe-88af-a9edc49f9da1]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]
Nov 14 22:13:24 user nova-compute[76815]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.
Nov 14 22:13:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a6ea0-d8c3-4a4c-a502-e90ff5b16c77]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] <== disconnect_volume: return (339ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:25 user nova-compute[76815]: WARNING nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state resized and task_state resize_reverting.
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:25 user nova-compute[76815]: WARNING nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state resized and task_state resize_reverting.
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:25 user nova-compute[76815]: WARNING nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state resized and task_state resize_reverting.
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:25 user nova-compute[76815]: WARNING nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state resized and task_state resize_reverting.
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:25 user nova-compute[76815]: WARNING nova.compute.manager [req-e067bc80-8e4c-4e19-8c63-db518dfcd475 req-0b9d88e9-65ea-4c9c-87d7-d194e8e12dcd service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state resized and task_state resize_reverting.
Nov 14 22:13:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:26 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:13:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:26 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:13:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:26 user nova-compute[76815]: INFO nova.compute.manager [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] instance snapshotting
Nov 14 22:13:26 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Beginning live snapshot process
Nov 14 22:13:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json -f qcow2 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json -f qcow2 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl78x9ilw/5e534e7b348d499ea09433953f9170af.delta 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl78x9ilw/5e534e7b348d499ea09433953f9170af.delta 1073741824" returned: 0 in 0.053s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lazy-loading 'migration_context' on Instance uuid 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.objects.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Object Instance<2a7d6b8f-698f-4e0b-a28e-131121d8fe8a> lazy-loaded attributes: resources,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:13:28 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 22:13:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:13:28 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Creating image(s)
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Ensure instance console log exists: /opt/stack/data/nova/instances/ce395be4-406e-4968-82c1-915443ebb273/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Start _get_guest_xml network_info=[{"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZGCtDFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce395be4-406e-4968-82c1-915443ebb273', 'attached_at': '', 'detached_at': '', 'volume_id': 'c801652b-2c73-4bae-b66f-6b36db51b4c3', 'serial': 'c801652b-2c73-4bae-b66f-6b36db51b4c3'}, 'attachment_id': '27a5d7a6-cb96-414f-9230-b03083faacf3', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:13:29 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:29 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.503s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl78x9ilw/5e534e7b348d499ea09433953f9170af.delta /opt/stack/data/nova/instances/snapshots/tmpl78x9ilw/5e534e7b348d499ea09433953f9170af {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZGCtDFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:13:29 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:13:29 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.025s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:13:29 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[843b1331-ac02-4b96-bc82-8457919302b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:13:29 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[457d2678-b04c-46f3-976a-ca936f4eaec0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3] added
Nov 14 22:13:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1078d6f-1378-4371-8866-cdcb2af6bf8f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc8f50-30b1-4055-93a7-357f83b07828]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZGCtDFX {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZGCtDFX" returned: 0 in 0.033s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7acce6-826d-40cb-9c4a-b55203dd0760]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OZGCtDFX'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18b3bf9-ba52-470b-9f64-4eafd8b3471f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49916cb-72ab-418a-bde0-80b8c16f7ae1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:13:29 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:13:29 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:13:29 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:13:29 user nova-compute[76815]: 
Nov 14 22:13:29 user nova-compute[76815]: INFO nova.compute.manager [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Swapping old allocation on dict_keys(['796094e8-bd05-4653-ba99-df40d0b26085']) held by migration ff042c3f-3a4f-4cfe-9681-d977ea50d8f9 for instance
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b74795-50ec-48ca-b57b-1f42d36886b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3, portal: 172.16.0.220,3260]
Nov 14 22:13:29 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3, portal: 172.16.0.220,3260] successful.
Nov 14 22:13:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Overwriting current allocation {'allocations': {'796094e8-bd05-4653-ba99-df40d0b26085': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '3021ff6fd9ad4958a9907c1b75f89a56', 'user_id': 'c82120460b2945879455016ed97cafe9', 'consumer_generation': 1} on consumer 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a {{(pid=76815) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7d5c92-9e1b-40b9-9119-05d4526e2376]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a727e2e-cee8-439b-9d04-7f968aeccab1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:13:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:13:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl78x9ilw/5e534e7b348d499ea09433953f9170af.delta /opt/stack/data/nova/instances/snapshots/tmpl78x9ilw/5e534e7b348d499ea09433953f9170af" returned: 0 in 0.498s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Snapshot extracted, beginning image upload
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd50db62-6cb7-4a06-8d38-dd054b1e1dcc]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZGCtDFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquired lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-c886b4e9-4e89-4a6b-8ec3-735994a53096 req-1217e248-45b0-4265-88a4-90e66935a13d service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received event network-changed-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-c886b4e9-4e89-4a6b-8ec3-735994a53096 req-1217e248-45b0-4265-88a4-90e66935a13d service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Refreshing instance network info cache due to event network-changed-dc5e49f0-2f7c-4750-86ab-270834c97d82. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c886b4e9-4e89-4a6b-8ec3-735994a53096 req-1217e248-45b0-4265-88a4-90e66935a13d service nova] Acquiring lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c886b4e9-4e89-4a6b-8ec3-735994a53096 req-1217e248-45b0-4265-88a4-90e66935a13d service nova] Acquired lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-c886b4e9-4e89-4a6b-8ec3-735994a53096 req-1217e248-45b0-4265-88a4-90e66935a13d service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Refreshing network info cache for port dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-c886b4e9-4e89-4a6b-8ec3-735994a53096 req-1217e248-45b0-4265-88a4-90e66935a13d service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updated VIF entry in instance network info cache for port dc5e49f0-2f7c-4750-86ab-270834c97d82. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-c886b4e9-4e89-4a6b-8ec3-735994a53096 req-1217e248-45b0-4265-88a4-90e66935a13d service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updating instance_info_cache with network_info: [{"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c886b4e9-4e89-4a6b-8ec3-735994a53096 req-1217e248-45b0-4265-88a4-90e66935a13d service nova] Releasing lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Releasing lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG os_brick.utils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[972d8d27-a821-42c3-b35c-e0100a93470b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f013ac6-e490-472c-8bf1-db8dcd9004d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c468dd7-c10d-4736-a7af-e8a0d133ce33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df3b766-0ca0-44f8-a696-f143c1574ca5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:13:30 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:13:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a38a488-478b-4167-a479-24b32ad7ef8c]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG os_brick.utils [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26262356437363839', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262356437363839', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1234337007',display_name='tempest-TestVolumeBootPattern-server-1234337007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1234337007',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-afzjlot1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:13:17Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=ce395be4-406e-4968-82c1-915443ebb273,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:69:ce,bridge_name='br-int',has_traffic_filtering=True,id=baeb019c-0942-4fc5-85bd-1833193e3167,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeb019c-09') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.objects.instance [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'pci_devices' on Instance uuid ce395be4-406e-4968-82c1-915443ebb273 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:13:30 user nova-compute[76815]:   <uuid>ce395be4-406e-4968-82c1-915443ebb273</uuid>
Nov 14 22:13:30 user nova-compute[76815]:   <name>instance-00000013</name>
Nov 14 22:13:30 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:13:30 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:13:30 user nova-compute[76815]:   <metadata>
Nov 14 22:13:30 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:13:30 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:13:30 user nova-compute[76815]:       <nova:name>tempest-TestVolumeBootPattern-server-1234337007</nova:name>
Nov 14 22:13:30 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:13:29</nova:creationTime>
Nov 14 22:13:30 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:13:30 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:13:30 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:13:30 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:13:30 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:13:30 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:13:30 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:13:30 user nova-compute[76815]:       <nova:owner>
Nov 14 22:13:30 user nova-compute[76815]:         <nova:user uuid="0fd5c7c940b0429994db55b93cb421ed">tempest-TestVolumeBootPattern-1821264948-project-member</nova:user>
Nov 14 22:13:30 user nova-compute[76815]:         <nova:project uuid="673708a9f12541f6929c86eb60ca83c8">tempest-TestVolumeBootPattern-1821264948</nova:project>
Nov 14 22:13:30 user nova-compute[76815]:       </nova:owner>
Nov 14 22:13:30 user nova-compute[76815]:       <nova:ports>
Nov 14 22:13:30 user nova-compute[76815]:         <nova:port uuid="baeb019c-0942-4fc5-85bd-1833193e3167">
Nov 14 22:13:30 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:13:30 user nova-compute[76815]:         </nova:port>
Nov 14 22:13:30 user nova-compute[76815]:       </nova:ports>
Nov 14 22:13:30 user nova-compute[76815]:     </nova:instance>
Nov 14 22:13:30 user nova-compute[76815]:   </metadata>
Nov 14 22:13:30 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:13:30 user nova-compute[76815]:     <system>
Nov 14 22:13:30 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:13:30 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:13:30 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:13:30 user nova-compute[76815]:       <entry name="serial">ce395be4-406e-4968-82c1-915443ebb273</entry>
Nov 14 22:13:30 user nova-compute[76815]:       <entry name="uuid">ce395be4-406e-4968-82c1-915443ebb273</entry>
Nov 14 22:13:30 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:13:30 user nova-compute[76815]:     </system>
Nov 14 22:13:30 user nova-compute[76815]:   </sysinfo>
Nov 14 22:13:30 user nova-compute[76815]:   <os>
Nov 14 22:13:30 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:13:30 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:13:30 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:13:30 user nova-compute[76815]:   </os>
Nov 14 22:13:30 user nova-compute[76815]:   <features>
Nov 14 22:13:30 user nova-compute[76815]:     <acpi/>
Nov 14 22:13:30 user nova-compute[76815]:     <apic/>
Nov 14 22:13:30 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:13:30 user nova-compute[76815]:   </features>
Nov 14 22:13:30 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:13:30 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:13:30 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:13:30 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:13:30 user nova-compute[76815]:   </clock>
Nov 14 22:13:30 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:13:30 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:13:30 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:13:30 user nova-compute[76815]:   </cpu>
Nov 14 22:13:30 user nova-compute[76815]:   <devices>
Nov 14 22:13:30 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:13:30 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:13:30 user nova-compute[76815]:       <source dev="/dev/sdb"/>
Nov 14 22:13:30 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:13:30 user nova-compute[76815]:       <serial>c801652b-2c73-4bae-b66f-6b36db51b4c3</serial>
Nov 14 22:13:30 user nova-compute[76815]:     </disk>
Nov 14 22:13:30 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:13:30 user nova-compute[76815]:       <mac address="fa:16:3e:ad:69:ce"/>
Nov 14 22:13:30 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:30 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:13:30 user nova-compute[76815]:       <target dev="tapbaeb019c-09"/>
Nov 14 22:13:30 user nova-compute[76815]:     </interface>
Nov 14 22:13:30 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:13:30 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/ce395be4-406e-4968-82c1-915443ebb273/console.log" append="off"/>
Nov 14 22:13:30 user nova-compute[76815]:     </serial>
Nov 14 22:13:30 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:13:30 user nova-compute[76815]:     <video>
Nov 14 22:13:30 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:30 user nova-compute[76815]:     </video>
Nov 14 22:13:30 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:13:30 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:13:30 user nova-compute[76815]:     </rng>
Nov 14 22:13:30 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:13:30 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:13:30 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:13:30 user nova-compute[76815]:     </memballoon>
Nov 14 22:13:30 user nova-compute[76815]:   </devices>
Nov 14 22:13:30 user nova-compute[76815]: </domain>
Nov 14 22:13:30 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1234337007',display_name='tempest-TestVolumeBootPattern-server-1234337007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1234337007',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-afzjlot1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:13:17Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=ce395be4-406e-4968-82c1-915443ebb273,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:69:ce,bridge_name='br-int',has_traffic_filtering=True,id=baeb019c-0942-4fc5-85bd-1833193e3167,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeb019c-09') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG os_vif [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:69:ce,bridge_name='br-int',has_traffic_filtering=True,id=baeb019c-0942-4fc5-85bd-1833193e3167,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeb019c-09') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1bcec811-df64-528b-83cd-9f167f2582ea', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaeb019c-09, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbaeb019c-09, col_values=(('qos', UUID('63968bfc-5682-44d0-845c-1e038bd5ec55')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbaeb019c-09, col_values=(('external_ids', {'iface-id': 'baeb019c-0942-4fc5-85bd-1833193e3167', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:69:ce', 'vm-uuid': 'ce395be4-406e-4968-82c1-915443ebb273'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:30 user nova-compute[76815]: INFO os_vif [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:69:ce,bridge_name='br-int',has_traffic_filtering=True,id=baeb019c-0942-4fc5-85bd-1833193e3167,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeb019c-09')
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:13:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No VIF found with MAC fa:16:3e:ad:69:ce, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:13:31 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-2b60a6d2-7cc7-4155-a6b4-6ac8563e50da req-c2029463-bede-48d7-a269-363022bd1e26 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received event network-vif-plugged-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2b60a6d2-7cc7-4155-a6b4-6ac8563e50da req-c2029463-bede-48d7-a269-363022bd1e26 service nova] Acquiring lock "ce395be4-406e-4968-82c1-915443ebb273-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2b60a6d2-7cc7-4155-a6b4-6ac8563e50da req-c2029463-bede-48d7-a269-363022bd1e26 service nova] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2b60a6d2-7cc7-4155-a6b4-6ac8563e50da req-c2029463-bede-48d7-a269-363022bd1e26 service nova] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-2b60a6d2-7cc7-4155-a6b4-6ac8563e50da req-c2029463-bede-48d7-a269-363022bd1e26 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] No waiting events found dispatching network-vif-plugged-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:32 user nova-compute[76815]: WARNING nova.compute.manager [req-2b60a6d2-7cc7-4155-a6b4-6ac8563e50da req-c2029463-bede-48d7-a269-363022bd1e26 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received unexpected event network-vif-plugged-baeb019c-0942-4fc5-85bd-1833193e3167 for instance with vm_state building and task_state spawning.
Nov 14 22:13:32 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Snapshot image upload complete
Nov 14 22:13:32 user nova-compute[76815]: INFO nova.compute.manager [None req-b725cccc-bbf5-4e76-8665-85889d9a14dc tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Took 6.09 seconds to snapshot the instance on the hypervisor.
Nov 14 22:13:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:33 user nova-compute[76815]: INFO nova.compute.manager [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Terminating instance
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e37129b4-8837-4c07-a006-d192afcfe3b3 req-c7b01169-3b76-4eb7-9204-d853e5e21231 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received event network-vif-unplugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e37129b4-8837-4c07-a006-d192afcfe3b3 req-c7b01169-3b76-4eb7-9204-d853e5e21231 service nova] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e37129b4-8837-4c07-a006-d192afcfe3b3 req-c7b01169-3b76-4eb7-9204-d853e5e21231 service nova] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e37129b4-8837-4c07-a006-d192afcfe3b3 req-c7b01169-3b76-4eb7-9204-d853e5e21231 service nova] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e37129b4-8837-4c07-a006-d192afcfe3b3 req-c7b01169-3b76-4eb7-9204-d853e5e21231 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] No waiting events found dispatching network-vif-unplugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e37129b4-8837-4c07-a006-d192afcfe3b3 req-c7b01169-3b76-4eb7-9204-d853e5e21231 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received event network-vif-unplugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Instance destroyed successfully.
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.objects.instance [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lazy-loading 'resources' on Instance uuid a3ba0d7d-48dd-4718-9447-fb632bd1e57b {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1152007292',display_name='tempest-VolumesAdminNegativeTest-server-1152007292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1152007292',id=3,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4JOZYnesMO0NW56EQswzCqpOxK07w+5wYCSkn1GESIYuqAKqN9bHEIj7HYRHLf+C8SrfHdZyqdUV+i7WRQfMsUczvAawHUChtJBeA1YQrYbPEuG1fKQcuXkVCT9LlFUg==',key_name='tempest-keypair-1851957661',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:08:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acd89e0ce8ea4637b1f83034d9264bf6',ramdisk_id='',reservation_id='r-wxqsmsrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-77219795',owner_user_name='tempest-VolumesAdminNegativeTest-77219795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='187becfe77604b6d9b4d7f2e8826631d',uuid=a3ba0d7d-48dd-4718-9447-fb632bd1e57b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converting VIF {"id": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "address": "fa:16:3e:16:6f:fe", "network": {"id": "11654cba-03ba-42ad-b6b3-3c99aa8d0a5f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1584987035-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acd89e0ce8ea4637b1f83034d9264bf6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26a0eb02-82", "ovs_interfaceid": "26a0eb02-82ba-4263-899f-9d49359e9dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:6f:fe,bridge_name='br-int',has_traffic_filtering=True,id=26a0eb02-82ba-4263-899f-9d49359e9dd5,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a0eb02-82') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG os_vif [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:6f:fe,bridge_name='br-int',has_traffic_filtering=True,id=26a0eb02-82ba-4263-899f-9d49359e9dd5,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a0eb02-82') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26a0eb02-82, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6301e89-6fd9-4169-8e91-48f26e3842a0) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:33 user nova-compute[76815]: INFO os_vif [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:6f:fe,bridge_name='br-int',has_traffic_filtering=True,id=26a0eb02-82ba-4263-899f-9d49359e9dd5,network=Network(11654cba-03ba-42ad-b6b3-3c99aa8d0a5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26a0eb02-82')
Nov 14 22:13:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Deleting instance files /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b_del
Nov 14 22:13:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Deletion of /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b_del complete
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3ba0d7d-48dd-4718-9447-fb632bd1e57b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:33 user nova-compute[76815]: INFO nova.compute.manager [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 22:13:33 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:13:33 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-470b65ca-58c1-4f48-9da3-1909ff852e5e req-b8d05d29-c967-4ee9-ae2d-f2c75c6cb697 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received event network-vif-plugged-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-470b65ca-58c1-4f48-9da3-1909ff852e5e req-b8d05d29-c967-4ee9-ae2d-f2c75c6cb697 service nova] Acquiring lock "ce395be4-406e-4968-82c1-915443ebb273-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-470b65ca-58c1-4f48-9da3-1909ff852e5e req-b8d05d29-c967-4ee9-ae2d-f2c75c6cb697 service nova] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-470b65ca-58c1-4f48-9da3-1909ff852e5e req-b8d05d29-c967-4ee9-ae2d-f2c75c6cb697 service nova] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-470b65ca-58c1-4f48-9da3-1909ff852e5e req-b8d05d29-c967-4ee9-ae2d-f2c75c6cb697 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] No waiting events found dispatching network-vif-plugged-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:34 user nova-compute[76815]: WARNING nova.compute.manager [req-470b65ca-58c1-4f48-9da3-1909ff852e5e req-b8d05d29-c967-4ee9-ae2d-f2c75c6cb697 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received unexpected event network-vif-plugged-baeb019c-0942-4fc5-85bd-1833193e3167 for instance with vm_state building and task_state spawning.
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:13:34 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: ce395be4-406e-4968-82c1-915443ebb273] Instance spawned successfully.
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:34 user nova-compute[76815]: INFO nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:34 user nova-compute[76815]: INFO nova.compute.manager [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Took 18.37 seconds to build instance.
Nov 14 22:13:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ab20e450-8f87-470d-af65-ff6081786de5 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ce395be4-406e-4968-82c1-915443ebb273" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.488s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:35 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Took 1.21 seconds to deallocate network for instance.
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-5d0bdaf7-328c-4b2a-9874-d660fd4d48f4 req-d7c51e4e-0b1d-45b6-9ee0-98e895d1bf94 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received event network-vif-plugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5d0bdaf7-328c-4b2a-9874-d660fd4d48f4 req-d7c51e4e-0b1d-45b6-9ee0-98e895d1bf94 service nova] Acquiring lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5d0bdaf7-328c-4b2a-9874-d660fd4d48f4 req-d7c51e4e-0b1d-45b6-9ee0-98e895d1bf94 service nova] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5d0bdaf7-328c-4b2a-9874-d660fd4d48f4 req-d7c51e4e-0b1d-45b6-9ee0-98e895d1bf94 service nova] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-5d0bdaf7-328c-4b2a-9874-d660fd4d48f4 req-d7c51e4e-0b1d-45b6-9ee0-98e895d1bf94 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] No waiting events found dispatching network-vif-plugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:35 user nova-compute[76815]: WARNING nova.compute.manager [req-5d0bdaf7-328c-4b2a-9874-d660fd4d48f4 req-d7c51e4e-0b1d-45b6-9ee0-98e895d1bf94 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received unexpected event network-vif-plugged-26a0eb02-82ba-4263-899f-9d49359e9dd5 for instance with vm_state deleted and task_state None.
Nov 14 22:13:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-5d0bdaf7-328c-4b2a-9874-d660fd4d48f4 req-d7c51e4e-0b1d-45b6-9ee0-98e895d1bf94 service nova] [instance: a3ba0d7d-48dd-4718-9447-fb632bd1e57b] Received event network-vif-deleted-26a0eb02-82ba-4263-899f-9d49359e9dd5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Starting finish_revert_migration {{(pid=76815) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.751s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.388s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Start _get_guest_xml network_info=[{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2a7d6b8f-698f-4e0b-a28e-131121d8fe8a', 'attached_at': '2023-11-14T22:13:36.000000', 'detached_at': '', 'volume_id': '925a86c5-4658-4b61-9360-7b14b96cfe4f', 'serial': '925a86c5-4658-4b61-9360-7b14b96cfe4f'}, 'attachment_id': 'c1f1690d-af6b-429c-b456-de9324c64bd6', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:13:36 user nova-compute[76815]: INFO nova.compute.claims [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Claim successful on node user
Nov 14 22:13:36 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:36 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:36 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Deleted allocations for instance a3ba0d7d-48dd-4718-9447-fb632bd1e57b
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:13:36 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:13:36 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:13:36 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e47afa9-afa0-451a-ae69-61965ff6836c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:13:36 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[659ec594-49d0-4d5d-b6cd-615663a0da7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f] added
Nov 14 22:13:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[caabffd7-21be-4b3c-a0bc-cccf5d194673]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1470cbac-1257-4422-a078-7556e7588248 tempest-VolumesAdminNegativeTest-77219795 tempest-VolumesAdminNegativeTest-77219795-project-member] Lock "a3ba0d7d-48dd-4718-9447-fb632bd1e57b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.597s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:36 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:36 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7621MB free_disk=25.281002044677734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[964b93a4-9190-4073-92f1-d5967335fae4]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v doZtJFaw {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v doZtJFaw" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e32281-f87c-447c-8ee2-4dd9a494cb8b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'doZtJFaw'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ac359-27c2-41d0-9ade-77ce3d5fdd6a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f4e9b4-8779-4398-bac2-a758deb0cd23]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:13:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:13:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b0eda8-151b-4b80-8076-0f57d7e49cb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]
Nov 14 22:13:36 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.
Nov 14 22:13:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb3d532-0477-4467-9001-b13161bd27af]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d05b21-90d0-44dd-95cd-2d0aa3c08df6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:13:36 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:13:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:13:36 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:13:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.661s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acffc49-9594-4401-a197-d3d0b3e74594]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.872s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:13:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.311s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:13:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.policy [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c67499628cb4369bc042f00b6a4303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a8307d87eb4927b49944f0a0055ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bb235db0-61d3-4e29-9794-b7c181f074d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0d55b663-e682-4d03-a613-a8895e301200 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 208d704d-b4a8-4fc6-b218-165448162e8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0dc9077f-493b-44b7-bfde-1d448ae001fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ce395be4-406e-4968-82c1-915443ebb273 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 800a8573-b384-4919-8871-d5dbda9da3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:13:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Creating image(s)
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "/opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "/opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "/opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.698s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] <== connect_volume: return (1699ms) {'type': 'block', 'scsi_wwn': '23037666264373761', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037666264373761', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-740046946',display_name='tempest-ServerActionsTestOtherB-server-740046946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-740046946',id=2,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfyvibJFZ3+P9cPClSwRvADUm92jfJ8o6BTO5uqmymmHB851px3NqgPd2QQeHEC+IldkPYJsk/5QKXvtU1Q/t5lYj1GQkm68rGyQFBVBYEDC0MsPp+SZUuhpQDRtsF5Yw==',key_name='tempest-keypair-689678311',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:11:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3021ff6fd9ad4958a9907c1b75f89a56',ramdisk_id='',reservation_id='r-uw1mr160',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-614422799',owner_user_name='tempest-ServerActionsTestOtherB-614422799-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82120460b2945879455016ed97cafe9',uuid=2a7d6b8f-698f-4e0b-a28e-131121d8fe8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converting VIF {"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:13:37 user nova-compute[76815]:   <uuid>2a7d6b8f-698f-4e0b-a28e-131121d8fe8a</uuid>
Nov 14 22:13:37 user nova-compute[76815]:   <name>instance-00000002</name>
Nov 14 22:13:37 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:13:37 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:13:37 user nova-compute[76815]:   <metadata>
Nov 14 22:13:37 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:13:37 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:13:37 user nova-compute[76815]:       <nova:name>tempest-ServerActionsTestOtherB-server-740046946</nova:name>
Nov 14 22:13:37 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:13:36</nova:creationTime>
Nov 14 22:13:37 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:13:37 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:13:37 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:13:37 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:13:37 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:13:37 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:13:37 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:13:37 user nova-compute[76815]:       <nova:owner>
Nov 14 22:13:37 user nova-compute[76815]:         <nova:user uuid="c82120460b2945879455016ed97cafe9">tempest-ServerActionsTestOtherB-614422799-project-member</nova:user>
Nov 14 22:13:37 user nova-compute[76815]:         <nova:project uuid="3021ff6fd9ad4958a9907c1b75f89a56">tempest-ServerActionsTestOtherB-614422799</nova:project>
Nov 14 22:13:37 user nova-compute[76815]:       </nova:owner>
Nov 14 22:13:37 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:13:37 user nova-compute[76815]:       <nova:ports>
Nov 14 22:13:37 user nova-compute[76815]:         <nova:port uuid="01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae">
Nov 14 22:13:37 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 22:13:37 user nova-compute[76815]:         </nova:port>
Nov 14 22:13:37 user nova-compute[76815]:       </nova:ports>
Nov 14 22:13:37 user nova-compute[76815]:     </nova:instance>
Nov 14 22:13:37 user nova-compute[76815]:   </metadata>
Nov 14 22:13:37 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:13:37 user nova-compute[76815]:     <system>
Nov 14 22:13:37 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:13:37 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:13:37 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:13:37 user nova-compute[76815]:       <entry name="serial">2a7d6b8f-698f-4e0b-a28e-131121d8fe8a</entry>
Nov 14 22:13:37 user nova-compute[76815]:       <entry name="uuid">2a7d6b8f-698f-4e0b-a28e-131121d8fe8a</entry>
Nov 14 22:13:37 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:13:37 user nova-compute[76815]:     </system>
Nov 14 22:13:37 user nova-compute[76815]:   </sysinfo>
Nov 14 22:13:37 user nova-compute[76815]:   <os>
Nov 14 22:13:37 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:13:37 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:13:37 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:13:37 user nova-compute[76815]:   </os>
Nov 14 22:13:37 user nova-compute[76815]:   <features>
Nov 14 22:13:37 user nova-compute[76815]:     <acpi/>
Nov 14 22:13:37 user nova-compute[76815]:     <apic/>
Nov 14 22:13:37 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:13:37 user nova-compute[76815]:   </features>
Nov 14 22:13:37 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:13:37 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:13:37 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:13:37 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:13:37 user nova-compute[76815]:   </clock>
Nov 14 22:13:37 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:13:37 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:13:37 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:13:37 user nova-compute[76815]:   </cpu>
Nov 14 22:13:37 user nova-compute[76815]:   <devices>
Nov 14 22:13:37 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:13:37 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:13:37 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk"/>
Nov 14 22:13:37 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:13:37 user nova-compute[76815]:     </disk>
Nov 14 22:13:37 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:13:37 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:13:37 user nova-compute[76815]:       <source dev="/dev/sdc"/>
Nov 14 22:13:37 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:13:37 user nova-compute[76815]:       <serial>925a86c5-4658-4b61-9360-7b14b96cfe4f</serial>
Nov 14 22:13:37 user nova-compute[76815]:     </disk>
Nov 14 22:13:37 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:13:37 user nova-compute[76815]:       <mac address="fa:16:3e:33:73:f8"/>
Nov 14 22:13:37 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:37 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:13:37 user nova-compute[76815]:       <target dev="tap01b0d4dc-1d"/>
Nov 14 22:13:37 user nova-compute[76815]:     </interface>
Nov 14 22:13:37 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:13:37 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/console.log" append="off"/>
Nov 14 22:13:37 user nova-compute[76815]:     </serial>
Nov 14 22:13:37 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:13:37 user nova-compute[76815]:     <video>
Nov 14 22:13:37 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:37 user nova-compute[76815]:     </video>
Nov 14 22:13:37 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:13:37 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:13:37 user nova-compute[76815]:     </rng>
Nov 14 22:13:37 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:13:37 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:13:37 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:13:37 user nova-compute[76815]:     </memballoon>
Nov 14 22:13:37 user nova-compute[76815]:   </devices>
Nov 14 22:13:37 user nova-compute[76815]: </domain>
Nov 14 22:13:37 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-740046946',display_name='tempest-ServerActionsTestOtherB-server-740046946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-740046946',id=2,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfyvibJFZ3+P9cPClSwRvADUm92jfJ8o6BTO5uqmymmHB851px3NqgPd2QQeHEC+IldkPYJsk/5QKXvtU1Q/t5lYj1GQkm68rGyQFBVBYEDC0MsPp+SZUuhpQDRtsF5Yw==',key_name='tempest-keypair-689678311',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:11:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3021ff6fd9ad4958a9907c1b75f89a56',ramdisk_id='',reservation_id='r-uw1mr160',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-614422799',owner_user_name='tempest-ServerActionsTestOtherB-614422799-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82120460b2945879455016ed97cafe9',uuid=2a7d6b8f-698f-4e0b-a28e-131121d8fe8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converting VIF {"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG os_vif [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.221s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f4db374-c304-5fcf-a542-83069f7f61a7', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.043s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b0d4dc-1d, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01b0d4dc-1d, col_values=(('qos', UUID('271e39ea-29ef-4130-9fa0-d94c0d9eae15')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01b0d4dc-1d, col_values=(('external_ids', {'iface-id': '01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:73:f8', 'vm-uuid': '2a7d6b8f-698f-4e0b-a28e-131121d8fe8a'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:38 user nova-compute[76815]: INFO os_vif [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d')
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Successfully created port: 4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.205s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk 1073741824" returned: 0 in 0.050s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Cannot resize image /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Ensure instance console log exists: /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Successfully updated port: 4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "refresh_cache-800a8573-b384-4919-8871-d5dbda9da3bd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquired lock "refresh_cache-800a8573-b384-4919-8871-d5dbda9da3bd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-525f9fb4-509e-4324-aa87-c7403cd71d36 req-84788c83-6a0c-4f71-8978-825868d82a7b service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received event network-changed-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-525f9fb4-509e-4324-aa87-c7403cd71d36 req-84788c83-6a0c-4f71-8978-825868d82a7b service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Refreshing instance network info cache due to event network-changed-4bdab381-62b2-40ae-8cd6-beab79fb7d70. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-525f9fb4-509e-4324-aa87-c7403cd71d36 req-84788c83-6a0c-4f71-8978-825868d82a7b service nova] Acquiring lock "refresh_cache-800a8573-b384-4919-8871-d5dbda9da3bd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Skipping network cache update for instance because it is Building. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Updating instance_info_cache with network_info: [{"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Releasing lock "refresh_cache-800a8573-b384-4919-8871-d5dbda9da3bd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Instance network_info: |[{"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-525f9fb4-509e-4324-aa87-c7403cd71d36 req-84788c83-6a0c-4f71-8978-825868d82a7b service nova] Acquired lock "refresh_cache-800a8573-b384-4919-8871-d5dbda9da3bd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-525f9fb4-509e-4324-aa87-c7403cd71d36 req-84788c83-6a0c-4f71-8978-825868d82a7b service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Refreshing network info cache for port 4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Start _get_guest_xml network_info=[{"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:13:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid bb235db0-61d3-4e29-9794-b7c181f074d2 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-689959966',display_name='tempest-VolumesSnapshotTestJSON-instance-689959966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-689959966',id=20,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDnRb/n5U1yiSeg/OdEJ4hDr4hZBvgL3/KEHZzWgb01eIZsJs2EzL+eHlyzGYBPVTQ5WRV5QAvrFsEsgqMKCdJ5taodx7bTUabyXA3OPOA4u3ei1XhOs2UE+7j8y2jwVQ==',key_name='tempest-keypair-2123050463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47a8307d87eb4927b49944f0a0055ef1',ramdisk_id='',reservation_id='r-cg1wpuhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1321856389',owner_user_name='tempest-VolumesSnapshotTestJSON-1321856389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c67499628cb4369bc042f00b6a4303b',uuid=800a8573-b384-4919-8871-d5dbda9da3bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converting VIF {"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:7f:3a,bridge_name='br-int',has_traffic_filtering=True,id=4bdab381-62b2-40ae-8cd6-beab79fb7d70,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bdab381-62') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.objects.instance [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'pci_devices' on Instance uuid 800a8573-b384-4919-8871-d5dbda9da3bd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:13:39 user nova-compute[76815]:   <uuid>800a8573-b384-4919-8871-d5dbda9da3bd</uuid>
Nov 14 22:13:39 user nova-compute[76815]:   <name>instance-00000014</name>
Nov 14 22:13:39 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:13:39 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:13:39 user nova-compute[76815]:   <metadata>
Nov 14 22:13:39 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:13:39 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:13:39 user nova-compute[76815]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-689959966</nova:name>
Nov 14 22:13:39 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:13:39</nova:creationTime>
Nov 14 22:13:39 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:13:39 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:13:39 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:13:39 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:13:39 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:13:39 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:13:39 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:13:39 user nova-compute[76815]:       <nova:owner>
Nov 14 22:13:39 user nova-compute[76815]:         <nova:user uuid="3c67499628cb4369bc042f00b6a4303b">tempest-VolumesSnapshotTestJSON-1321856389-project-member</nova:user>
Nov 14 22:13:39 user nova-compute[76815]:         <nova:project uuid="47a8307d87eb4927b49944f0a0055ef1">tempest-VolumesSnapshotTestJSON-1321856389</nova:project>
Nov 14 22:13:39 user nova-compute[76815]:       </nova:owner>
Nov 14 22:13:39 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:13:39 user nova-compute[76815]:       <nova:ports>
Nov 14 22:13:39 user nova-compute[76815]:         <nova:port uuid="4bdab381-62b2-40ae-8cd6-beab79fb7d70">
Nov 14 22:13:39 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 22:13:39 user nova-compute[76815]:         </nova:port>
Nov 14 22:13:39 user nova-compute[76815]:       </nova:ports>
Nov 14 22:13:39 user nova-compute[76815]:     </nova:instance>
Nov 14 22:13:39 user nova-compute[76815]:   </metadata>
Nov 14 22:13:39 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:13:39 user nova-compute[76815]:     <system>
Nov 14 22:13:39 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:13:39 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:13:39 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:13:39 user nova-compute[76815]:       <entry name="serial">800a8573-b384-4919-8871-d5dbda9da3bd</entry>
Nov 14 22:13:39 user nova-compute[76815]:       <entry name="uuid">800a8573-b384-4919-8871-d5dbda9da3bd</entry>
Nov 14 22:13:39 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:13:39 user nova-compute[76815]:     </system>
Nov 14 22:13:39 user nova-compute[76815]:   </sysinfo>
Nov 14 22:13:39 user nova-compute[76815]:   <os>
Nov 14 22:13:39 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:13:39 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:13:39 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:13:39 user nova-compute[76815]:   </os>
Nov 14 22:13:39 user nova-compute[76815]:   <features>
Nov 14 22:13:39 user nova-compute[76815]:     <acpi/>
Nov 14 22:13:39 user nova-compute[76815]:     <apic/>
Nov 14 22:13:39 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:13:39 user nova-compute[76815]:   </features>
Nov 14 22:13:39 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:13:39 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:13:39 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:13:39 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:13:39 user nova-compute[76815]:   </clock>
Nov 14 22:13:39 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:13:39 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:13:39 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:13:39 user nova-compute[76815]:   </cpu>
Nov 14 22:13:39 user nova-compute[76815]:   <devices>
Nov 14 22:13:39 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:13:39 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:13:39 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk"/>
Nov 14 22:13:39 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:13:39 user nova-compute[76815]:     </disk>
Nov 14 22:13:39 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:13:39 user nova-compute[76815]:       <mac address="fa:16:3e:99:7f:3a"/>
Nov 14 22:13:39 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:39 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:13:39 user nova-compute[76815]:       <target dev="tap4bdab381-62"/>
Nov 14 22:13:39 user nova-compute[76815]:     </interface>
Nov 14 22:13:39 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:13:39 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/console.log" append="off"/>
Nov 14 22:13:39 user nova-compute[76815]:     </serial>
Nov 14 22:13:39 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:13:39 user nova-compute[76815]:     <video>
Nov 14 22:13:39 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:39 user nova-compute[76815]:     </video>
Nov 14 22:13:39 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:13:39 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:13:39 user nova-compute[76815]:     </rng>
Nov 14 22:13:39 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:13:39 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:13:39 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:13:39 user nova-compute[76815]:     </memballoon>
Nov 14 22:13:39 user nova-compute[76815]:   </devices>
Nov 14 22:13:39 user nova-compute[76815]: </domain>
Nov 14 22:13:39 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-689959966',display_name='tempest-VolumesSnapshotTestJSON-instance-689959966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-689959966',id=20,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDnRb/n5U1yiSeg/OdEJ4hDr4hZBvgL3/KEHZzWgb01eIZsJs2EzL+eHlyzGYBPVTQ5WRV5QAvrFsEsgqMKCdJ5taodx7bTUabyXA3OPOA4u3ei1XhOs2UE+7j8y2jwVQ==',key_name='tempest-keypair-2123050463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47a8307d87eb4927b49944f0a0055ef1',ramdisk_id='',reservation_id='r-cg1wpuhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1321856389',owner_user_name='tempest-VolumesSnapshotTestJSON-1321856389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c67499628cb4369bc042f00b6a4303b',uuid=800a8573-b384-4919-8871-d5dbda9da3bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converting VIF {"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:7f:3a,bridge_name='br-int',has_traffic_filtering=True,id=4bdab381-62b2-40ae-8cd6-beab79fb7d70,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bdab381-62') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG os_vif [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:7f:3a,bridge_name='br-int',has_traffic_filtering=True,id=4bdab381-62b2-40ae-8cd6-beab79fb7d70,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bdab381-62') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41cf353d-7457-598e-ad7d-34e7069ca4c1', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bdab381-62, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4bdab381-62, col_values=(('qos', UUID('c9c50112-9133-415c-b16e-70b989449fc5')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4bdab381-62, col_values=(('external_ids', {'iface-id': '4bdab381-62b2-40ae-8cd6-beab79fb7d70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:7f:3a', 'vm-uuid': '800a8573-b384-4919-8871-d5dbda9da3bd'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: INFO os_vif [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:7f:3a,bridge_name='br-int',has_traffic_filtering=True,id=4bdab381-62b2-40ae-8cd6-beab79fb7d70,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bdab381-62')
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No VIF found with MAC fa:16:3e:99:7f:3a, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-d5a31257-677e-40d7-8df4-91e6d53d4234 req-a23362cc-4575-4111-9ada-73222d694852 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d5a31257-677e-40d7-8df4-91e6d53d4234 req-a23362cc-4575-4111-9ada-73222d694852 service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d5a31257-677e-40d7-8df4-91e6d53d4234 req-a23362cc-4575-4111-9ada-73222d694852 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d5a31257-677e-40d7-8df4-91e6d53d4234 req-a23362cc-4575-4111-9ada-73222d694852 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-d5a31257-677e-40d7-8df4-91e6d53d4234 req-a23362cc-4575-4111-9ada-73222d694852 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:39 user nova-compute[76815]: WARNING nova.compute.manager [req-d5a31257-677e-40d7-8df4-91e6d53d4234 req-a23362cc-4575-4111-9ada-73222d694852 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state resized and task_state resize_reverting.
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-525f9fb4-509e-4324-aa87-c7403cd71d36 req-84788c83-6a0c-4f71-8978-825868d82a7b service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Updated VIF entry in instance network info cache for port 4bdab381-62b2-40ae-8cd6-beab79fb7d70. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-525f9fb4-509e-4324-aa87-c7403cd71d36 req-84788c83-6a0c-4f71-8978-825868d82a7b service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Updating instance_info_cache with network_info: [{"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-525f9fb4-509e-4324-aa87-c7403cd71d36 req-84788c83-6a0c-4f71-8978-825868d82a7b service nova] Releasing lock "refresh_cache-800a8573-b384-4919-8871-d5dbda9da3bd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Updating instance_info_cache with network_info: [{"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-bb235db0-61d3-4e29-9794-b7c181f074d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:13:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:13:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-fce9f337-a21c-4a17-ac1d-5f456d95dc98 req-c78c84d6-95ed-4336-ab38-da8aed763a12 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received event network-vif-plugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fce9f337-a21c-4a17-ac1d-5f456d95dc98 req-c78c84d6-95ed-4336-ab38-da8aed763a12 service nova] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fce9f337-a21c-4a17-ac1d-5f456d95dc98 req-c78c84d6-95ed-4336-ab38-da8aed763a12 service nova] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fce9f337-a21c-4a17-ac1d-5f456d95dc98 req-c78c84d6-95ed-4336-ab38-da8aed763a12 service nova] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-fce9f337-a21c-4a17-ac1d-5f456d95dc98 req-c78c84d6-95ed-4336-ab38-da8aed763a12 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] No waiting events found dispatching network-vif-plugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:41 user nova-compute[76815]: WARNING nova.compute.manager [req-fce9f337-a21c-4a17-ac1d-5f456d95dc98 req-c78c84d6-95ed-4336-ab38-da8aed763a12 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received unexpected event network-vif-plugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 for instance with vm_state building and task_state spawning.
Nov 14 22:13:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ed53f6d-6647-4767-aadf-07269bd2f097 req-7e2416c9-ce97-45fe-8905-0f6c3a1b3495 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ed53f6d-6647-4767-aadf-07269bd2f097 req-7e2416c9-ce97-45fe-8905-0f6c3a1b3495 service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ed53f6d-6647-4767-aadf-07269bd2f097 req-7e2416c9-ce97-45fe-8905-0f6c3a1b3495 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8ed53f6d-6647-4767-aadf-07269bd2f097 req-7e2416c9-ce97-45fe-8905-0f6c3a1b3495 service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-8ed53f6d-6647-4767-aadf-07269bd2f097 req-7e2416c9-ce97-45fe-8905-0f6c3a1b3495 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:41 user nova-compute[76815]: WARNING nova.compute.manager [req-8ed53f6d-6647-4767-aadf-07269bd2f097 req-7e2416c9-ce97-45fe-8905-0f6c3a1b3495 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state resized and task_state resize_reverting.
Nov 14 22:13:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:13:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance running successfully.
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] finish_revert_migration finished successfully. {{(pid=76815) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 22:13:43 user nova-compute[76815]: INFO nova.compute.manager [None req-f031aa16-f2e3-4b69-9a4f-ae7c4bff09a5 tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance to original state: 'active'
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:13:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Instance spawned successfully.
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-1af1a349-4ae2-4887-86f9-72c761be061a req-393fef9e-4af1-4c2d-8ad1-6fc9d4db2fdd service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received event network-vif-plugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1af1a349-4ae2-4887-86f9-72c761be061a req-393fef9e-4af1-4c2d-8ad1-6fc9d4db2fdd service nova] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1af1a349-4ae2-4887-86f9-72c761be061a req-393fef9e-4af1-4c2d-8ad1-6fc9d4db2fdd service nova] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1af1a349-4ae2-4887-86f9-72c761be061a req-393fef9e-4af1-4c2d-8ad1-6fc9d4db2fdd service nova] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-1af1a349-4ae2-4887-86f9-72c761be061a req-393fef9e-4af1-4c2d-8ad1-6fc9d4db2fdd service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] No waiting events found dispatching network-vif-plugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:13:43 user nova-compute[76815]: WARNING nova.compute.manager [req-1af1a349-4ae2-4887-86f9-72c761be061a req-393fef9e-4af1-4c2d-8ad1-6fc9d4db2fdd service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received unexpected event network-vif-plugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 for instance with vm_state building and task_state spawning.
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:13:43 user nova-compute[76815]: INFO nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 14 22:13:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:13:43 user nova-compute[76815]: INFO nova.compute.manager [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Took 8.01 seconds to build instance.
Nov 14 22:13:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-181c3de2-b575-48a7-91b1-6f22cb4b30e6 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.161s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "0d55b663-e682-4d03-a613-a8895e301200" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "0d55b663-e682-4d03-a613-a8895e301200" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "0d55b663-e682-4d03-a613-a8895e301200-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "0d55b663-e682-4d03-a613-a8895e301200-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "0d55b663-e682-4d03-a613-a8895e301200-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:53 user nova-compute[76815]: INFO nova.compute.manager [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Terminating instance
Nov 14 22:13:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:13:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:54 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Instance destroyed successfully.
Nov 14 22:13:54 user nova-compute[76815]: DEBUG nova.objects.instance [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lazy-loading 'resources' on Instance uuid 0d55b663-e682-4d03-a613-a8895e301200 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-67071073',display_name='tempest-VolumesActionsTest-instance-67071073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-67071073',id=16,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:12:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9c9996c7ec44bdf912e9dfc6cd852a0',ramdisk_id='',reservation_id='r-zc9fqzah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-439034333',owner_user_name='tempest-VolumesActionsTest-439034333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:12:10Z,user_data=None,user_id='4b7935d9b21649d6a22c6b8700fbee4f',uuid=0d55b663-e682-4d03-a613-a8895e301200,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converting VIF {"id": "51343da9-091a-4e9e-9aaa-5d358b2943df", "address": "fa:16:3e:fa:62:c8", "network": {"id": "52f00f93-6297-4327-b13c-a0cec8230915", "bridge": "br-int", "label": "tempest-VolumesActionsTest-791429256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9c9996c7ec44bdf912e9dfc6cd852a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51343da9-09", "ovs_interfaceid": "51343da9-091a-4e9e-9aaa-5d358b2943df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:62:c8,bridge_name='br-int',has_traffic_filtering=True,id=51343da9-091a-4e9e-9aaa-5d358b2943df,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51343da9-09') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG os_vif [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:62:c8,bridge_name='br-int',has_traffic_filtering=True,id=51343da9-091a-4e9e-9aaa-5d358b2943df,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51343da9-09') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51343da9-09, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c91fe7d2-0a53-40e6-ba09-24cb9abe3da9) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:54 user nova-compute[76815]: INFO os_vif [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:62:c8,bridge_name='br-int',has_traffic_filtering=True,id=51343da9-091a-4e9e-9aaa-5d358b2943df,network=Network(52f00f93-6297-4327-b13c-a0cec8230915),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51343da9-09')
Nov 14 22:13:54 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Deleting instance files /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200_del
Nov 14 22:13:54 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Deletion of /opt/stack/data/nova/instances/0d55b663-e682-4d03-a613-a8895e301200_del complete
Nov 14 22:13:54 user nova-compute[76815]: INFO nova.compute.manager [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 14 22:13:54 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:13:54 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 0d55b663-e682-4d03-a613-a8895e301200] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:13:55 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-249d2d1d-0d2e-417d-a341-a63adb849669 req-4202b5ad-e010-4d91-833b-593f7015e01d service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Received event network-vif-deleted-51343da9-091a-4e9e-9aaa-5d358b2943df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:55 user nova-compute[76815]: INFO nova.compute.manager [req-249d2d1d-0d2e-417d-a341-a63adb849669 req-4202b5ad-e010-4d91-833b-593f7015e01d service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Neutron deleted interface 51343da9-091a-4e9e-9aaa-5d358b2943df; detaching it from the instance and deleting it from the info cache
Nov 14 22:13:55 user nova-compute[76815]: DEBUG nova.network.neutron [req-249d2d1d-0d2e-417d-a341-a63adb849669 req-4202b5ad-e010-4d91-833b-593f7015e01d service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:55 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Took 0.82 seconds to deallocate network for instance.
Nov 14 22:13:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-249d2d1d-0d2e-417d-a341-a63adb849669 req-4202b5ad-e010-4d91-833b-593f7015e01d service nova] [instance: 0d55b663-e682-4d03-a613-a8895e301200] Detach interface failed, port_id=51343da9-091a-4e9e-9aaa-5d358b2943df, reason: Instance 0d55b663-e682-4d03-a613-a8895e301200 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:13:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:55 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:13:55 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:13:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:55 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Deleted allocations for instance 0d55b663-e682-4d03-a613-a8895e301200
Nov 14 22:13:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfd8e697-f29b-4ed9-8002-7b9fb55b379f tempest-VolumesActionsTest-439034333 tempest-VolumesActionsTest-439034333-project-member] Lock "0d55b663-e682-4d03-a613-a8895e301200" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.126s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:13:57 user nova-compute[76815]: INFO nova.compute.claims [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Claim successful on node user
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:13:57 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.policy [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '118f7d4d7bb14c6ca51e6f5f7d23eeea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c8421bdaad4948a0bed9f8a96be15c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:13:57 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Creating image(s)
Nov 14 22:13:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "/opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "/opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "/opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk 1073741824" returned: 0 in 0.049s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.202s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Successfully created port: 7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Cannot resize image /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Ensure instance console log exists: /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:13:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Successfully updated port: 7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "refresh_cache-df6f5090-eb0a-49b6-8e6c-e46475f7c784" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquired lock "refresh_cache-df6f5090-eb0a-49b6-8e6c-e46475f7c784" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.compute.manager [req-81fe3907-07da-46a8-81e8-1bf4d7b26e6b req-a1b30c52-5d1b-49be-838d-47c9f36c8866 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received event network-changed-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.compute.manager [req-81fe3907-07da-46a8-81e8-1bf4d7b26e6b req-a1b30c52-5d1b-49be-838d-47c9f36c8866 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Refreshing instance network info cache due to event network-changed-7775a114-c778-45fb-b919-c1fb32485bf6. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-81fe3907-07da-46a8-81e8-1bf4d7b26e6b req-a1b30c52-5d1b-49be-838d-47c9f36c8866 service nova] Acquiring lock "refresh_cache-df6f5090-eb0a-49b6-8e6c-e46475f7c784" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Updating instance_info_cache with network_info: [{"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Releasing lock "refresh_cache-df6f5090-eb0a-49b6-8e6c-e46475f7c784" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Instance network_info: |[{"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-81fe3907-07da-46a8-81e8-1bf4d7b26e6b req-a1b30c52-5d1b-49be-838d-47c9f36c8866 service nova] Acquired lock "refresh_cache-df6f5090-eb0a-49b6-8e6c-e46475f7c784" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.neutron [req-81fe3907-07da-46a8-81e8-1bf4d7b26e6b req-a1b30c52-5d1b-49be-838d-47c9f36c8866 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Refreshing network info cache for port 7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Start _get_guest_xml network_info=[{"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:13:59 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:59 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076223539',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076223539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2076223',id=21,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3fzSuEmOgnJJKCghM0skCa4E1Dkl8/HskxpUw1NUUFq8Pf7pHgVQPeyqHPlz7g3RGblpZC3A4d5K37CCeM98M3Q7GhmMRURHCuu3B5qBDEve63m0u62imMOIf1/ITTaA==',key_name='tempest-keypair-1887405505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c8421bdaad4948a0bed9f8a96be15c',ramdisk_id='',reservation_id='r-i52e9050',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1622516646',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='118f7d4d7bb14c6ca51e6f5f7d23eeea',uuid=df6f5090-eb0a-49b6-8e6c-e46475f7c784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Converting VIF {"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:4e:33,bridge_name='br-int',has_traffic_filtering=True,id=7775a114-c778-45fb-b919-c1fb32485bf6,network=Network(ef6ec381-69cd-4bb4-954e-2dab83b076ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a114-c7') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.objects.instance [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lazy-loading 'pci_devices' on Instance uuid df6f5090-eb0a-49b6-8e6c-e46475f7c784 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:13:59 user nova-compute[76815]:   <uuid>df6f5090-eb0a-49b6-8e6c-e46475f7c784</uuid>
Nov 14 22:13:59 user nova-compute[76815]:   <name>instance-00000015</name>
Nov 14 22:13:59 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:13:59 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:13:59 user nova-compute[76815]:   <metadata>
Nov 14 22:13:59 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:13:59 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:13:59 user nova-compute[76815]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2076223539</nova:name>
Nov 14 22:13:59 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:13:59</nova:creationTime>
Nov 14 22:13:59 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:13:59 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:13:59 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:13:59 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:13:59 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:13:59 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:13:59 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:13:59 user nova-compute[76815]:       <nova:owner>
Nov 14 22:13:59 user nova-compute[76815]:         <nova:user uuid="118f7d4d7bb14c6ca51e6f5f7d23eeea">tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member</nova:user>
Nov 14 22:13:59 user nova-compute[76815]:         <nova:project uuid="66c8421bdaad4948a0bed9f8a96be15c">tempest-TestServerVolumeAttachScenarioOldVersion-1622516646</nova:project>
Nov 14 22:13:59 user nova-compute[76815]:       </nova:owner>
Nov 14 22:13:59 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:13:59 user nova-compute[76815]:       <nova:ports>
Nov 14 22:13:59 user nova-compute[76815]:         <nova:port uuid="7775a114-c778-45fb-b919-c1fb32485bf6">
Nov 14 22:13:59 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 22:13:59 user nova-compute[76815]:         </nova:port>
Nov 14 22:13:59 user nova-compute[76815]:       </nova:ports>
Nov 14 22:13:59 user nova-compute[76815]:     </nova:instance>
Nov 14 22:13:59 user nova-compute[76815]:   </metadata>
Nov 14 22:13:59 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:13:59 user nova-compute[76815]:     <system>
Nov 14 22:13:59 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:13:59 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:13:59 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:13:59 user nova-compute[76815]:       <entry name="serial">df6f5090-eb0a-49b6-8e6c-e46475f7c784</entry>
Nov 14 22:13:59 user nova-compute[76815]:       <entry name="uuid">df6f5090-eb0a-49b6-8e6c-e46475f7c784</entry>
Nov 14 22:13:59 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:13:59 user nova-compute[76815]:     </system>
Nov 14 22:13:59 user nova-compute[76815]:   </sysinfo>
Nov 14 22:13:59 user nova-compute[76815]:   <os>
Nov 14 22:13:59 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:13:59 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:13:59 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:13:59 user nova-compute[76815]:   </os>
Nov 14 22:13:59 user nova-compute[76815]:   <features>
Nov 14 22:13:59 user nova-compute[76815]:     <acpi/>
Nov 14 22:13:59 user nova-compute[76815]:     <apic/>
Nov 14 22:13:59 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:13:59 user nova-compute[76815]:   </features>
Nov 14 22:13:59 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:13:59 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:13:59 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:13:59 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:13:59 user nova-compute[76815]:   </clock>
Nov 14 22:13:59 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:13:59 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:13:59 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:13:59 user nova-compute[76815]:   </cpu>
Nov 14 22:13:59 user nova-compute[76815]:   <devices>
Nov 14 22:13:59 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:13:59 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:13:59 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk"/>
Nov 14 22:13:59 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:13:59 user nova-compute[76815]:     </disk>
Nov 14 22:13:59 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:13:59 user nova-compute[76815]:       <mac address="fa:16:3e:65:4e:33"/>
Nov 14 22:13:59 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:59 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:13:59 user nova-compute[76815]:       <target dev="tap7775a114-c7"/>
Nov 14 22:13:59 user nova-compute[76815]:     </interface>
Nov 14 22:13:59 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:13:59 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/console.log" append="off"/>
Nov 14 22:13:59 user nova-compute[76815]:     </serial>
Nov 14 22:13:59 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:13:59 user nova-compute[76815]:     <video>
Nov 14 22:13:59 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:13:59 user nova-compute[76815]:     </video>
Nov 14 22:13:59 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:13:59 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:13:59 user nova-compute[76815]:     </rng>
Nov 14 22:13:59 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:13:59 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:13:59 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:13:59 user nova-compute[76815]:     </memballoon>
Nov 14 22:13:59 user nova-compute[76815]:   </devices>
Nov 14 22:13:59 user nova-compute[76815]: </domain>
Nov 14 22:13:59 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076223539',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076223539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2076223',id=21,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3fzSuEmOgnJJKCghM0skCa4E1Dkl8/HskxpUw1NUUFq8Pf7pHgVQPeyqHPlz7g3RGblpZC3A4d5K37CCeM98M3Q7GhmMRURHCuu3B5qBDEve63m0u62imMOIf1/ITTaA==',key_name='tempest-keypair-1887405505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66c8421bdaad4948a0bed9f8a96be15c',ramdisk_id='',reservation_id='r-i52e9050',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1622516646',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='118f7d4d7bb14c6ca51e6f5f7d23eeea',uuid=df6f5090-eb0a-49b6-8e6c-e46475f7c784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Converting VIF {"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:4e:33,bridge_name='br-int',has_traffic_filtering=True,id=7775a114-c778-45fb-b919-c1fb32485bf6,network=Network(ef6ec381-69cd-4bb4-954e-2dab83b076ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a114-c7') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG os_vif [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:4e:33,bridge_name='br-int',has_traffic_filtering=True,id=7775a114-c778-45fb-b919-c1fb32485bf6,network=Network(ef6ec381-69cd-4bb4-954e-2dab83b076ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a114-c7') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f0066e3-4b07-583e-b5be-ecad35a0f7ec', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7775a114-c7, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7775a114-c7, col_values=(('qos', UUID('c2daf406-f687-4903-84e4-2decf676f7c0')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7775a114-c7, col_values=(('external_ids', {'iface-id': '7775a114-c778-45fb-b919-c1fb32485bf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:4e:33', 'vm-uuid': 'df6f5090-eb0a-49b6-8e6c-e46475f7c784'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:13:59 user nova-compute[76815]: INFO os_vif [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:4e:33,bridge_name='br-int',has_traffic_filtering=True,id=7775a114-c778-45fb-b919-c1fb32485bf6,network=Network(ef6ec381-69cd-4bb4-954e-2dab83b076ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a114-c7')
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] No VIF found with MAC fa:16:3e:65:4e:33, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.neutron [req-81fe3907-07da-46a8-81e8-1bf4d7b26e6b req-a1b30c52-5d1b-49be-838d-47c9f36c8866 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Updated VIF entry in instance network info cache for port 7775a114-c778-45fb-b919-c1fb32485bf6. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG nova.network.neutron [req-81fe3907-07da-46a8-81e8-1bf4d7b26e6b req-a1b30c52-5d1b-49be-838d-47c9f36c8866 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Updating instance_info_cache with network_info: [{"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:13:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-81fe3907-07da-46a8-81e8-1bf4d7b26e6b req-a1b30c52-5d1b-49be-838d-47c9f36c8866 service nova] Releasing lock "refresh_cache-df6f5090-eb0a-49b6-8e6c-e46475f7c784" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:14:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:01 user nova-compute[76815]: DEBUG nova.compute.manager [req-48e96478-fbbb-4ee4-985a-419c26937452 req-44c27bc2-2061-4d64-8a0d-361d11564ee5 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received event network-vif-plugged-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:14:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-48e96478-fbbb-4ee4-985a-419c26937452 req-44c27bc2-2061-4d64-8a0d-361d11564ee5 service nova] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-48e96478-fbbb-4ee4-985a-419c26937452 req-44c27bc2-2061-4d64-8a0d-361d11564ee5 service nova] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-48e96478-fbbb-4ee4-985a-419c26937452 req-44c27bc2-2061-4d64-8a0d-361d11564ee5 service nova] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:01 user nova-compute[76815]: DEBUG nova.compute.manager [req-48e96478-fbbb-4ee4-985a-419c26937452 req-44c27bc2-2061-4d64-8a0d-361d11564ee5 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] No waiting events found dispatching network-vif-plugged-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:14:01 user nova-compute[76815]: WARNING nova.compute.manager [req-48e96478-fbbb-4ee4-985a-419c26937452 req-44c27bc2-2061-4d64-8a0d-361d11564ee5 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received unexpected event network-vif-plugged-7775a114-c778-45fb-b919-c1fb32485bf6 for instance with vm_state building and task_state spawning.
Nov 14 22:14:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:14:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Instance spawned successfully.
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:03 user nova-compute[76815]: INFO nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:14:03 user nova-compute[76815]: INFO nova.compute.manager [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Took 6.02 seconds to build instance.
Nov 14 22:14:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6d095a73-04a3-4453-a46f-3c11eacdd0f8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.117s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-22b0d291-584a-4268-acad-6104187f52ad req-700f2acc-f515-470a-95a7-f1b6631bcd3b service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received event network-vif-plugged-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22b0d291-584a-4268-acad-6104187f52ad req-700f2acc-f515-470a-95a7-f1b6631bcd3b service nova] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22b0d291-584a-4268-acad-6104187f52ad req-700f2acc-f515-470a-95a7-f1b6631bcd3b service nova] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22b0d291-584a-4268-acad-6104187f52ad req-700f2acc-f515-470a-95a7-f1b6631bcd3b service nova] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-22b0d291-584a-4268-acad-6104187f52ad req-700f2acc-f515-470a-95a7-f1b6631bcd3b service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] No waiting events found dispatching network-vif-plugged-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:14:03 user nova-compute[76815]: WARNING nova.compute.manager [req-22b0d291-584a-4268-acad-6104187f52ad req-700f2acc-f515-470a-95a7-f1b6631bcd3b service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received unexpected event network-vif-plugged-7775a114-c778-45fb-b919-c1fb32485bf6 for instance with vm_state active and task_state None.
Nov 14 22:14:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_power_states {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid bb235db0-61d3-4e29-9794-b7c181f074d2 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid a8bb243d-ad93-47ae-8fbe-b5845a29496d {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 065c90e1-2099-4446-a998-de681bedf500 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 208d704d-b4a8-4fc6-b218-165448162e8f {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 0dc9077f-493b-44b7-bfde-1d448ae001fd {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid ce395be4-406e-4968-82c1-915443ebb273 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 800a8573-b384-4919-8871-d5dbda9da3bd {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid df6f5090-eb0a-49b6-8e6c-e46475f7c784 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "bb235db0-61d3-4e29-9794-b7c181f074d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "065c90e1-2099-4446-a998-de681bedf500" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "065c90e1-2099-4446-a998-de681bedf500" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "ce395be4-406e-4968-82c1-915443ebb273" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "ce395be4-406e-4968-82c1-915443ebb273" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "065c90e1-2099-4446-a998-de681bedf500" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "ce395be4-406e-4968-82c1-915443ebb273" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lazy-loading 'flavor' on Instance uuid 208d704d-b4a8-4fc6-b218-165448162e8f {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:27 user nova-compute[76815]: INFO nova.compute.manager [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Attaching volume 99c91fc6-3c8e-4133-88f4-69b256a3cfda to /dev/vdb
Nov 14 22:14:27 user nova-compute[76815]: DEBUG os_brick.utils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[19852521-fae6-414f-b26b-5c5ae6adf944]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed51e82-c395-4328-81f7-89431883b08b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee03948c-c2cf-4d2d-b08e-34724f38f8ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7539b65-ba6e-4b7b-967f-6d38d6160041]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:14:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:14:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:14:28 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:14:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c0ece7-e8d7-4dfe-8f5d-ba42acd54159]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:14:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:14:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:14:28 user nova-compute[76815]: DEBUG os_brick.utils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:14:28 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Updating existing volume attachment record: 6c6fc714-0551-41f2-a259-6eaefcce0e38 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:14:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:31 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:31 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsdtEuPm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:14:32 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:14:32 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:14:32 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2034f31c-04c7-4d62-84c9-f5b2d96cf4ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:14:32 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f5228d-ceff-4e0c-8003-758821f625b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda] added
Nov 14 22:14:32 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d06d7da-eef7-44b4-acf9-6888e7325ef0]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[05950a6f-6747-476c-82c6-382c14f04bde]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsdtEuPm {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsdtEuPm" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64acd0b0-ebf9-4d5e-ae60-11630cdc7610]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bsdtEuPm'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b9bb24-cc17-4ad5-8508-8f81c88dd33e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d856092c-54e0-449b-8d8f-665965982ec7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:14:32 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:14:32 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:14:32 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:14:32 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[460009af-fc5b-42b0-aa3d-2adc47c4ea89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda, portal: 172.16.0.220,3260]
Nov 14 22:14:32 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda, portal: 172.16.0.220,3260] successful.
Nov 14 22:14:32 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[244ad38d-2dd6-4f99-8075-0b43417df067]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[02068784-b811-4533-95fd-28c6eae529b1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:14:32 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:14:32 user nova-compute[76815]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda (non-flash)
Nov 14 22:14:32 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:14:32 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:14:32 user nova-compute[76815]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda (non-flash)
Nov 14 22:14:32 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78466af5-4172-468a-be5e-dba92fd301e2]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:32 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsdtEuPm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23335313738653637', 'path': '/dev/sdd'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335313738653637', 'path': '/dev/sdd'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lazy-loading 'flavor' on Instance uuid 208d704d-b4a8-4fc6-b218-165448162e8f {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:14:33 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:14:33 user nova-compute[76815]:   <source dev="/dev/sdd"/>
Nov 14 22:14:33 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:14:33 user nova-compute[76815]:   <serial>99c91fc6-3c8e-4133-88f4-69b256a3cfda</serial>
Nov 14 22:14:33 user nova-compute[76815]: </disk>
Nov 14 22:14:33 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:14:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:14:34 user nova-compute[76815]: INFO nova.compute.claims [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Claim successful on node user
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] No VIF found with MAC fa:16:3e:01:e8:10, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f308b97f-ac39-4e25-ad94-ab9a9e24bdc5 tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.581s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:14:34 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:34 user nova-compute[76815]: DEBUG nova.policy [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85a900897f3a42bd89f966f4b7e253f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7e88b0ec54c5b9f15ae859e8c3984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:14:35 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Creating image(s)
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk 1073741824" returned: 0 in 0.055s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:35 user nova-compute[76815]: INFO nova.compute.manager [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Terminating instance
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Successfully created port: 0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-e5223b39-d295-4aed-aa39-cefd12927b08 req-a510ea03-9c37-4b86-ae55-7a18f4a21a69 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received event network-vif-unplugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5223b39-d295-4aed-aa39-cefd12927b08 req-a510ea03-9c37-4b86-ae55-7a18f4a21a69 service nova] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5223b39-d295-4aed-aa39-cefd12927b08 req-a510ea03-9c37-4b86-ae55-7a18f4a21a69 service nova] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5223b39-d295-4aed-aa39-cefd12927b08 req-a510ea03-9c37-4b86-ae55-7a18f4a21a69 service nova] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-e5223b39-d295-4aed-aa39-cefd12927b08 req-a510ea03-9c37-4b86-ae55-7a18f4a21a69 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] No waiting events found dispatching network-vif-unplugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-e5223b39-d295-4aed-aa39-cefd12927b08 req-a510ea03-9c37-4b86-ae55-7a18f4a21a69 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received event network-vif-unplugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Cannot resize image /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Ensure instance console log exists: /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:36 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Instance destroyed successfully.
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Successfully updated port: 0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.objects.instance [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lazy-loading 'resources' on Instance uuid 208d704d-b4a8-4fc6-b218-165448162e8f {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:12:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-406328270',display_name='tempest-DeleteServersTestJSON-server-406328270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-406328270',id=17,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:12:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a8ddef6a4594cedb3d53bfa0b42071b',ramdisk_id='',reservation_id='r-psszfzr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-308956267',owner_user_name='tempest-DeleteServersTestJSON-308956267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:12:44Z,user_data=None,user_id='7eef7606b4184821bb5f6da806c94aee',uuid=208d704d-b4a8-4fc6-b218-165448162e8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Converting VIF {"id": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "address": "fa:16:3e:01:e8:10", "network": {"id": "8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-574140536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a8ddef6a4594cedb3d53bfa0b42071b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd04ae56c-a0", "ovs_interfaceid": "d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3,network=Network(8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04ae56c-a0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_vif [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3,network=Network(8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04ae56c-a0') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd04ae56c-a0, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-377db13c-c854-43fd-a83c-fac5e5c21906 req-c7357a04-b50b-4091-b581-001382b953e4 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-changed-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-377db13c-c854-43fd-a83c-fac5e5c21906 req-c7357a04-b50b-4091-b581-001382b953e4 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Refreshing instance network info cache due to event network-changed-0ce994cd-fb33-42e5-80c7-0878f2e9890a. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-377db13c-c854-43fd-a83c-fac5e5c21906 req-c7357a04-b50b-4091-b581-001382b953e4 service nova] Acquiring lock "refresh_cache-bc3a520b-21e4-463e-a39d-a397c3e6b811" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-377db13c-c854-43fd-a83c-fac5e5c21906 req-c7357a04-b50b-4091-b581-001382b953e4 service nova] Acquired lock "refresh_cache-bc3a520b-21e4-463e-a39d-a397c3e6b811" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-377db13c-c854-43fd-a83c-fac5e5c21906 req-c7357a04-b50b-4091-b581-001382b953e4 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Refreshing network info cache for port 0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "refresh_cache-bc3a520b-21e4-463e-a39d-a397c3e6b811" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22bc08a6-2c79-499a-b839-149805bb09f5) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:14:36 user nova-compute[76815]: INFO os_vif [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e8:10,bridge_name='br-int',has_traffic_filtering=True,id=d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3,network=Network(8bb5f5e0-b6e5-4c85-834b-d3bda7a22dc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd04ae56c-a0')
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsdtEuPm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:14:36 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-377db13c-c854-43fd-a83c-fac5e5c21906 req-c7357a04-b50b-4091-b581-001382b953e4 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eff4e8e-cbfd-4042-a5d0-f45bf992407c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:14:36 user nova-compute[76815]: No targets found.
Nov 14 22:14:36 user nova-compute[76815]: iSNS:
Nov 14 22:14:36 user nova-compute[76815]: No targets found.
Nov 14 22:14:36 user nova-compute[76815]: STATIC:
Nov 14 22:14:36 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3
Nov 14 22:14:36 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:14:36 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:14:36 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda
Nov 14 22:14:36 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:14:36 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:14:36 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f
Nov 14 22:14:36 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:14:36 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:14:36 user nova-compute[76815]: FIRMWARE:
Nov 14 22:14:36 user nova-compute[76815]: No targets found.
Nov 14 22:14:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:14:36 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:14:36 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:36 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:14:36 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:14:36 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7403MB free_disk=25.315570831298828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a952ae-7e25-4a88-9869-519bb775168e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab5841-5186-4c16-8da1-2fb45738cea0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:14:36 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:14:36 user nova-compute[76815]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda (non-flash)
Nov 14 22:14:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:14:36 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:14:36 user nova-compute[76815]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda (non-flash)
Nov 14 22:14:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c862a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda'): ({'sdd'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Removing single pathed devices sdd {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c654e-1534-4b37-936b-1241e6e12077]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ec7acd-5362-4574-b7af-f8153d95e88f]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Flushing IO for device /dev/sdd {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bb235db0-61d3-4e29-9794-b7c181f074d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 208d704d-b4a8-4fc6-b218-165448162e8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0dc9077f-493b-44b7-bfde-1d448ae001fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ce395be4-406e-4968-82c1-915443ebb273 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 800a8573-b384-4919-8871-d5dbda9da3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance df6f5090-eb0a-49b6-8e6c-e46475f7c784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bc3a520b-21e4-463e-a39d-a397c3e6b811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9ca63e-3dc4-4333-9590-8afba3c66648]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0390b3a-5802-4df4-81d6-30c0c6bf8e85]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] SCSI volumes sdd have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ed283c-12db-4537-8d62-6ea9580541c6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[49931222-15db-4545-83dd-9f1869dd6daa]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda, portal: 172.16.0.220,3260]
Nov 14 22:14:37 user nova-compute[76815]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda, portal: 172.16.0.220,3260] successful.
Nov 14 22:14:37 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c91fc6-3c8e-4133-88f4-69b256a3cfda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b10e40-67cd-4314-bfcc-4f179f98bf74]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.738s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] <== disconnect_volume: return (740ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:14:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Deleting instance files /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f_del
Nov 14 22:14:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Deletion of /opt/stack/data/nova/instances/208d704d-b4a8-4fc6-b218-165448162e8f_del complete
Nov 14 22:14:37 user nova-compute[76815]: INFO nova.compute.manager [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Took 1.70 seconds to destroy the instance on the hypervisor.
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-377db13c-c854-43fd-a83c-fac5e5c21906 req-c7357a04-b50b-4091-b581-001382b953e4 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-377db13c-c854-43fd-a83c-fac5e5c21906 req-c7357a04-b50b-4091-b581-001382b953e4 service nova] Releasing lock "refresh_cache-bc3a520b-21e4-463e-a39d-a397c3e6b811" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquired lock "refresh_cache-bc3a520b-21e4-463e-a39d-a397c3e6b811" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Updating instance_info_cache with network_info: [{"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Releasing lock "refresh_cache-bc3a520b-21e4-463e-a39d-a397c3e6b811" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance network_info: |[{"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Start _get_guest_xml network_info=[{"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:14:37 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:14:37 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-154093738',display_name='tempest-tempest.common.compute-instance-154093738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-154093738',id=22,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnVf2EWXLMs2o+nLDUXPoKm0hgmUOTA1zAb/3U4CPDjSB7YxhNV5mJeWkrA2EmLxBCKN0nz61aoShmbeUlFgdVdFbCYX1l1oQTWzXwjLMEqD/lfWCuGPtA9s6dLyaaG9A==',key_name='tempest-keypair-1456019355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-7f3rq2il',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=bc3a520b-21e4-463e-a39d-a397c3e6b811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.objects.instance [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'pci_devices' on Instance uuid bc3a520b-21e4-463e-a39d-a397c3e6b811 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-5475ca63-ea1d-4b9e-8189-f3eb48a0a705 req-3721fb5c-0932-4cc0-a8b0-b7126bd30330 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received event network-vif-deleted-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:14:37 user nova-compute[76815]: INFO nova.compute.manager [req-5475ca63-ea1d-4b9e-8189-f3eb48a0a705 req-3721fb5c-0932-4cc0-a8b0-b7126bd30330 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Neutron deleted interface d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3; detaching it from the instance and deleting it from the info cache
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-5475ca63-ea1d-4b9e-8189-f3eb48a0a705 req-3721fb5c-0932-4cc0-a8b0-b7126bd30330 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:14:37 user nova-compute[76815]:   <uuid>bc3a520b-21e4-463e-a39d-a397c3e6b811</uuid>
Nov 14 22:14:37 user nova-compute[76815]:   <name>instance-00000016</name>
Nov 14 22:14:37 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:14:37 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:14:37 user nova-compute[76815]:   <metadata>
Nov 14 22:14:37 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:14:37 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:14:37 user nova-compute[76815]:       <nova:name>tempest-tempest.common.compute-instance-154093738</nova:name>
Nov 14 22:14:37 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:14:37</nova:creationTime>
Nov 14 22:14:37 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:14:37 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:14:37 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:14:37 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:14:37 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:14:37 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:14:37 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:14:37 user nova-compute[76815]:       <nova:owner>
Nov 14 22:14:37 user nova-compute[76815]:         <nova:user uuid="85a900897f3a42bd89f966f4b7e253f6">tempest-ServerActionsTestOtherA-2016206168-project-member</nova:user>
Nov 14 22:14:37 user nova-compute[76815]:         <nova:project uuid="60b7e88b0ec54c5b9f15ae859e8c3984">tempest-ServerActionsTestOtherA-2016206168</nova:project>
Nov 14 22:14:37 user nova-compute[76815]:       </nova:owner>
Nov 14 22:14:37 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:14:37 user nova-compute[76815]:       <nova:ports>
Nov 14 22:14:37 user nova-compute[76815]:         <nova:port uuid="0ce994cd-fb33-42e5-80c7-0878f2e9890a">
Nov 14 22:14:37 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:14:37 user nova-compute[76815]:         </nova:port>
Nov 14 22:14:37 user nova-compute[76815]:       </nova:ports>
Nov 14 22:14:37 user nova-compute[76815]:     </nova:instance>
Nov 14 22:14:37 user nova-compute[76815]:   </metadata>
Nov 14 22:14:37 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:14:37 user nova-compute[76815]:     <system>
Nov 14 22:14:37 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:14:37 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:14:37 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:14:37 user nova-compute[76815]:       <entry name="serial">bc3a520b-21e4-463e-a39d-a397c3e6b811</entry>
Nov 14 22:14:37 user nova-compute[76815]:       <entry name="uuid">bc3a520b-21e4-463e-a39d-a397c3e6b811</entry>
Nov 14 22:14:37 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:14:37 user nova-compute[76815]:     </system>
Nov 14 22:14:37 user nova-compute[76815]:   </sysinfo>
Nov 14 22:14:37 user nova-compute[76815]:   <os>
Nov 14 22:14:37 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:14:37 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:14:37 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:14:37 user nova-compute[76815]:   </os>
Nov 14 22:14:37 user nova-compute[76815]:   <features>
Nov 14 22:14:37 user nova-compute[76815]:     <acpi/>
Nov 14 22:14:37 user nova-compute[76815]:     <apic/>
Nov 14 22:14:37 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:14:37 user nova-compute[76815]:   </features>
Nov 14 22:14:37 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:14:37 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:14:37 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:14:37 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:14:37 user nova-compute[76815]:   </clock>
Nov 14 22:14:37 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:14:37 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:14:37 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:14:37 user nova-compute[76815]:   </cpu>
Nov 14 22:14:37 user nova-compute[76815]:   <devices>
Nov 14 22:14:37 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:14:37 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:14:37 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk"/>
Nov 14 22:14:37 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:14:37 user nova-compute[76815]:     </disk>
Nov 14 22:14:37 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:14:37 user nova-compute[76815]:       <mac address="fa:16:3e:ec:14:23"/>
Nov 14 22:14:37 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:14:37 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:14:37 user nova-compute[76815]:       <target dev="tap0ce994cd-fb"/>
Nov 14 22:14:37 user nova-compute[76815]:     </interface>
Nov 14 22:14:37 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:14:37 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/console.log" append="off"/>
Nov 14 22:14:37 user nova-compute[76815]:     </serial>
Nov 14 22:14:37 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:14:37 user nova-compute[76815]:     <video>
Nov 14 22:14:37 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:14:37 user nova-compute[76815]:     </video>
Nov 14 22:14:37 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:14:37 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:14:37 user nova-compute[76815]:     </rng>
Nov 14 22:14:37 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:14:37 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:14:37 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:14:37 user nova-compute[76815]:     </memballoon>
Nov 14 22:14:37 user nova-compute[76815]:   </devices>
Nov 14 22:14:37 user nova-compute[76815]: </domain>
Nov 14 22:14:37 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-154093738',display_name='tempest-tempest.common.compute-instance-154093738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-154093738',id=22,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnVf2EWXLMs2o+nLDUXPoKm0hgmUOTA1zAb/3U4CPDjSB7YxhNV5mJeWkrA2EmLxBCKN0nz61aoShmbeUlFgdVdFbCYX1l1oQTWzXwjLMEqD/lfWCuGPtA9s6dLyaaG9A==',key_name='tempest-keypair-1456019355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-7f3rq2il',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=bc3a520b-21e4-463e-a39d-a397c3e6b811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG os_vif [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e04db8c6-2a71-54b3-a9b0-de0d202cbaa4', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:14:37 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Took 0.51 seconds to deallocate network for instance.
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ce994cd-fb, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ce994cd-fb, col_values=(('qos', UUID('65597c82-dcec-4115-9167-b91887c496ac')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ce994cd-fb, col_values=(('external_ids', {'iface-id': '0ce994cd-fb33-42e5-80c7-0878f2e9890a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:14:23', 'vm-uuid': 'bc3a520b-21e4-463e-a39d-a397c3e6b811'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:37 user nova-compute[76815]: INFO os_vif [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb')
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-5475ca63-ea1d-4b9e-8189-f3eb48a0a705 req-3721fb5c-0932-4cc0-a8b0-b7126bd30330 service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Detach interface failed, port_id=d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3, reason: Instance 208d704d-b4a8-4fc6-b218-165448162e8f could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No VIF found with MAC fa:16:3e:ec:14:23, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-3bc51447-e296-450a-b609-6835920391b9 req-1fb6728c-030f-4a4f-b731-18177d8ab19b service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received event network-vif-plugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3bc51447-e296-450a-b609-6835920391b9 req-1fb6728c-030f-4a4f-b731-18177d8ab19b service nova] Acquiring lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3bc51447-e296-450a-b609-6835920391b9 req-1fb6728c-030f-4a4f-b731-18177d8ab19b service nova] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3bc51447-e296-450a-b609-6835920391b9 req-1fb6728c-030f-4a4f-b731-18177d8ab19b service nova] Lock "208d704d-b4a8-4fc6-b218-165448162e8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-3bc51447-e296-450a-b609-6835920391b9 req-1fb6728c-030f-4a4f-b731-18177d8ab19b service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] No waiting events found dispatching network-vif-plugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:14:37 user nova-compute[76815]: WARNING nova.compute.manager [req-3bc51447-e296-450a-b609-6835920391b9 req-1fb6728c-030f-4a4f-b731-18177d8ab19b service nova] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Received unexpected event network-vif-plugged-d04ae56c-a070-4b4d-bcf7-ea9c4cc153f3 for instance with vm_state active and task_state deleting.
Nov 14 22:14:38 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:38 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:14:38 user nova-compute[76815]: INFO nova.compute.manager [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] [instance: 208d704d-b4a8-4fc6-b218-165448162e8f] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 22:14:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:38 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:14:38 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:14:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:38 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Deleted allocations for instance 208d704d-b4a8-4fc6-b218-165448162e8f
Nov 14 22:14:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1404a363-b350-4338-a648-cbe0fea2795c tempest-DeleteServersTestJSON-308956267 tempest-DeleteServersTestJSON-308956267-project-member] Lock "208d704d-b4a8-4fc6-b218-165448162e8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.417s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-d3a92ff6-bf36-4acf-a2ba-76b5884a00e0 req-5870834c-5104-4ec3-84b3-469266649dd7 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d3a92ff6-bf36-4acf-a2ba-76b5884a00e0 req-5870834c-5104-4ec3-84b3-469266649dd7 service nova] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d3a92ff6-bf36-4acf-a2ba-76b5884a00e0 req-5870834c-5104-4ec3-84b3-469266649dd7 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d3a92ff6-bf36-4acf-a2ba-76b5884a00e0 req-5870834c-5104-4ec3-84b3-469266649dd7 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-d3a92ff6-bf36-4acf-a2ba-76b5884a00e0 req-5870834c-5104-4ec3-84b3-469266649dd7 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] No waiting events found dispatching network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:14:39 user nova-compute[76815]: WARNING nova.compute.manager [req-d3a92ff6-bf36-4acf-a2ba-76b5884a00e0 req-5870834c-5104-4ec3-84b3-469266649dd7 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received unexpected event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a for instance with vm_state building and task_state spawning.
Nov 14 22:14:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [{"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:14:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-d2e55ad8-8d9e-4aa3-ae62-ac3bfb59d4a3 req-da8ea419-3fee-4f82-aa04-c2beca12c2dc service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d2e55ad8-8d9e-4aa3-ae62-ac3bfb59d4a3 req-da8ea419-3fee-4f82-aa04-c2beca12c2dc service nova] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d2e55ad8-8d9e-4aa3-ae62-ac3bfb59d4a3 req-da8ea419-3fee-4f82-aa04-c2beca12c2dc service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d2e55ad8-8d9e-4aa3-ae62-ac3bfb59d4a3 req-da8ea419-3fee-4f82-aa04-c2beca12c2dc service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-d2e55ad8-8d9e-4aa3-ae62-ac3bfb59d4a3 req-da8ea419-3fee-4f82-aa04-c2beca12c2dc service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] No waiting events found dispatching network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:14:41 user nova-compute[76815]: WARNING nova.compute.manager [req-d2e55ad8-8d9e-4aa3-ae62-ac3bfb59d4a3 req-da8ea419-3fee-4f82-aa04-c2beca12c2dc service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received unexpected event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a for instance with vm_state building and task_state spawning.
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:14:41 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance spawned successfully.
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:14:41 user nova-compute[76815]: INFO nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 14 22:14:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:14:41 user nova-compute[76815]: INFO nova.compute.manager [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Took 7.56 seconds to build instance.
Nov 14 22:14:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7962dff9-65ee-4d81-b5b3-bfa90c651b0f tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.686s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:14:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:14:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:14:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:14:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-361ff37f-5422-4d67-b50f-8e5cc769167f req-f70f5737-539b-4893-befc-57f435f6226c service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received event network-changed-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:14:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-361ff37f-5422-4d67-b50f-8e5cc769167f req-f70f5737-539b-4893-befc-57f435f6226c service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Refreshing instance network info cache due to event network-changed-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:14:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-361ff37f-5422-4d67-b50f-8e5cc769167f req-f70f5737-539b-4893-befc-57f435f6226c service nova] Acquiring lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:14:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-361ff37f-5422-4d67-b50f-8e5cc769167f req-f70f5737-539b-4893-befc-57f435f6226c service nova] Acquired lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:14:56 user nova-compute[76815]: DEBUG nova.network.neutron [req-361ff37f-5422-4d67-b50f-8e5cc769167f req-f70f5737-539b-4893-befc-57f435f6226c service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Refreshing network info cache for port 6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:14:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:56 user nova-compute[76815]: DEBUG nova.network.neutron [req-361ff37f-5422-4d67-b50f-8e5cc769167f req-f70f5737-539b-4893-befc-57f435f6226c service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updated VIF entry in instance network info cache for port 6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:14:56 user nova-compute[76815]: DEBUG nova.network.neutron [req-361ff37f-5422-4d67-b50f-8e5cc769167f req-f70f5737-539b-4893-befc-57f435f6226c service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updating instance_info_cache with network_info: [{"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:14:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-361ff37f-5422-4d67-b50f-8e5cc769167f req-f70f5737-539b-4893-befc-57f435f6226c service nova] Releasing lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:14:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:14:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG nova.objects.instance [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'flavor' on Instance uuid 0dc9077f-493b-44b7-bfde-1d448ae001fd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.363s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:14:58 user nova-compute[76815]: INFO nova.compute.manager [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Attaching volume 4f46cd54-cd36-4cb5-ad11-694876af58ac to /dev/vdb
Nov 14 22:14:58 user nova-compute[76815]: DEBUG os_brick.utils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4698b3c8-6bd1-4547-8a7b-d1c8309e0427]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c888ab01-6bee-4b1c-94f6-38b602c84ba0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e68d2aa-ae1a-4cdb-8773-b5253c5dab57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3805e952-0d83-4d17-95e7-5f4f9977ddc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:14:59 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:14:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47c5ed3-2f46-4976-8df1-35ad8e7d680d]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG os_brick.utils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:14:59 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updating existing volume attachment record: b3b6b028-359a-40f7-a56b-d506227b92d4 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:15:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXFZePjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:04 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:04 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:04 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260" returned: 21 in 0.062s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfaafbc-d661-4298-8ae1-33e1af17d7f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:15:04 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d6b3d2-c374-4de2-bcb2-b125786c023c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac] added
Nov 14 22:15:04 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f113fa1d-57f0-4d88-b9d3-e6efa334e566]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.115s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf326d6-70c4-4bc1-9fdf-58892deb2437]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXFZePjd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXFZePjd" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcaec96-01e9-4d04-ab21-32862f4254a7]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXFZePjd'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba760c81-ce8d-43a2-a084-56fe126fb669]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9524a5a0-00f0-47d2-a0ff-286ad39d7dbb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:15:04 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:04 user nova-compute[76815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed (non-flash)
Nov 14 22:15:04 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:15:04 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:04 user nova-compute[76815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed (non-flash)
Nov 14 22:15:04 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --login" returned: 0 in 1.125s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0e1588-fd14-4df3-a7b7-87b087201040]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac, portal: 172.16.0.220,3260]
Nov 14 22:15:05 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac, portal: 172.16.0.220,3260] successful.
Nov 14 22:15:05 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7837fb4-38e4-469d-b4ae-aebbab583eaf]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c39b9f-baf3-478c-8dab-accbfdd5a3b0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:15:05 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:05 user nova-compute[76815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed (non-flash)
Nov 14 22:15:05 user nova-compute[76815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac (non-flash)
Nov 14 22:15:05 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:15:05 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:05 user nova-compute[76815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed (non-flash)
Nov 14 22:15:05 user nova-compute[76815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac (non-flash)
Nov 14 22:15:05 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.601s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:15:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fd289d-9ce4-4ae8-a3b2-5cd43d011939]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:06 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:15:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXFZePjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.642s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] <== connect_volume: return (2643ms) {'type': 'block', 'scsi_wwn': '23965303434666339', 'path': '/dev/sde'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965303434666339', 'path': '/dev/sde'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "ce395be4-406e-4968-82c1-915443ebb273" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ce395be4-406e-4968-82c1-915443ebb273" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "ce395be4-406e-4968-82c1-915443ebb273-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:07 user nova-compute[76815]: INFO nova.compute.manager [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Terminating instance
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.objects.instance [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'flavor' on Instance uuid 0dc9077f-493b-44b7-bfde-1d448ae001fd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:15:07 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:15:07 user nova-compute[76815]:   <source dev="/dev/sde"/>
Nov 14 22:15:07 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:15:07 user nova-compute[76815]:   <serial>4f46cd54-cd36-4cb5-ad11-694876af58ac</serial>
Nov 14 22:15:07 user nova-compute[76815]: </disk>
Nov 14 22:15:07 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-4f2782ae-6118-4000-847b-bea6473091dc req-05df93a1-cc88-4943-a321-4186b178dae3 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received event network-vif-unplugged-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4f2782ae-6118-4000-847b-bea6473091dc req-05df93a1-cc88-4943-a321-4186b178dae3 service nova] Acquiring lock "ce395be4-406e-4968-82c1-915443ebb273-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4f2782ae-6118-4000-847b-bea6473091dc req-05df93a1-cc88-4943-a321-4186b178dae3 service nova] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4f2782ae-6118-4000-847b-bea6473091dc req-05df93a1-cc88-4943-a321-4186b178dae3 service nova] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-4f2782ae-6118-4000-847b-bea6473091dc req-05df93a1-cc88-4943-a321-4186b178dae3 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] No waiting events found dispatching network-vif-unplugged-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-4f2782ae-6118-4000-847b-bea6473091dc req-05df93a1-cc88-4943-a321-4186b178dae3 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received event network-vif-unplugged-baeb019c-0942-4fc5-85bd-1833193e3167 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No VIF found with MAC fa:16:3e:31:e3:01, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-207ef806-e873-4308-acd1-b6fceced37d7 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.047s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: ce395be4-406e-4968-82c1-915443ebb273] Instance destroyed successfully.
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'resources' on Instance uuid ce395be4-406e-4968-82c1-915443ebb273 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1234337007',display_name='tempest-TestVolumeBootPattern-server-1234337007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1234337007',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:13:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-afzjlot1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:13:35Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=ce395be4-406e-4968-82c1-915443ebb273,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "baeb019c-0942-4fc5-85bd-1833193e3167", "address": "fa:16:3e:ad:69:ce", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaeb019c-09", "ovs_interfaceid": "baeb019c-0942-4fc5-85bd-1833193e3167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:69:ce,bridge_name='br-int',has_traffic_filtering=True,id=baeb019c-0942-4fc5-85bd-1833193e3167,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeb019c-09') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG os_vif [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:69:ce,bridge_name='br-int',has_traffic_filtering=True,id=baeb019c-0942-4fc5-85bd-1833193e3167,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeb019c-09') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaeb019c-09, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63968bfc-5682-44d0-845c-1e038bd5ec55) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:15:07 user nova-compute[76815]: INFO os_vif [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:69:ce,bridge_name='br-int',has_traffic_filtering=True,id=baeb019c-0942-4fc5-85bd-1833193e3167,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaeb019c-09')
Nov 14 22:15:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZGCtDFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:08 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f7aa58-2b06-44fe-a740-7603689336aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:15:08 user nova-compute[76815]: No targets found.
Nov 14 22:15:08 user nova-compute[76815]: iSNS:
Nov 14 22:15:08 user nova-compute[76815]: No targets found.
Nov 14 22:15:08 user nova-compute[76815]: STATIC:
Nov 14 22:15:08 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed
Nov 14 22:15:08 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:15:08 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:15:08 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3
Nov 14 22:15:08 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:15:08 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:15:08 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac
Nov 14 22:15:08 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:15:08 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:15:08 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f
Nov 14 22:15:08 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:15:08 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:15:08 user nova-compute[76815]: FIRMWARE:
Nov 14 22:15:08 user nova-compute[76815]: No targets found.
Nov 14 22:15:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:15:08 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:15:08 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[303f9da7-4094-450f-bc56-68b02937c7fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8d09bf-4a1d-42cf-b5ec-60be7c352910]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:15:08 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:08 user nova-compute[76815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed (non-flash)
Nov 14 22:15:08 user nova-compute[76815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac (non-flash)
Nov 14 22:15:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 (non-flash)
Nov 14 22:15:08 user nova-compute[76815]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:08 user nova-compute[76815]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6df0d458-cb78-418f-b1ef-ae86ecda03ed (non-flash)
Nov 14 22:15:08 user nova-compute[76815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac (non-flash)
Nov 14 22:15:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8629360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[09325a2e-eb88-4032-8820-a32c8dd100ee]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee18ef-f714-40d8-ba26-1d3ed1cad743]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaa8ac2-7792-4d0e-8d3e-2233b24c906d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e215be7-d794-4d5f-aa3d-cd24b45562d4]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4a0a8419-bb5d7689fad88e4c', '/dev/disk/by-id/scsi-26262356437363839', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4a0a8419') {{(pid=86648) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 22:15:08 user nova-compute[76815]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO4a0a8419-bb5d7689fad88e4c
Nov 14 22:15:08 user nova-compute[76815]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26262356437363839
Nov 14 22:15:08 user nova-compute[76815]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_4a0a8419
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80fef28-1b17-41f0-a679-555d533c9539]: (4, None) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6f18fb-0acf-4cce-867e-1025179e4595]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dc1d83-d0c3-4d48-9ef9-ce58ac878dea]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3, portal: 172.16.0.220,3260]
Nov 14 22:15:08 user nova-compute[76815]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3, portal: 172.16.0.220,3260] successful.
Nov 14 22:15:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c801652b-2c73-4bae-b66f-6b36db51b4c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[445a1f45-580c-4bec-9350-26534eb478f3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== disconnect_volume: return (381ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:15:08 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Deleting instance files /opt/stack/data/nova/instances/ce395be4-406e-4968-82c1-915443ebb273_del
Nov 14 22:15:08 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Deletion of /opt/stack/data/nova/instances/ce395be4-406e-4968-82c1-915443ebb273_del complete
Nov 14 22:15:08 user nova-compute[76815]: INFO nova.compute.manager [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 14 22:15:08 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: ce395be4-406e-4968-82c1-915443ebb273] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: ce395be4-406e-4968-82c1-915443ebb273] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:15:08 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: ce395be4-406e-4968-82c1-915443ebb273] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:15:08 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: ce395be4-406e-4968-82c1-915443ebb273] Took 0.53 seconds to deallocate network for instance.
Nov 14 22:15:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-ddc100e3-2822-42c2-8ce9-553b11c9acd8 req-0d474d10-1f82-4d57-a14a-5a01160c261a service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received event network-vif-deleted-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-07d822eb-0939-45ba-b691-fc6aa666e308 req-bfca9860-c1b4-4431-a2c9-a50084f75676 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received event network-vif-plugged-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-07d822eb-0939-45ba-b691-fc6aa666e308 req-bfca9860-c1b4-4431-a2c9-a50084f75676 service nova] Acquiring lock "ce395be4-406e-4968-82c1-915443ebb273-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-07d822eb-0939-45ba-b691-fc6aa666e308 req-bfca9860-c1b4-4431-a2c9-a50084f75676 service nova] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-07d822eb-0939-45ba-b691-fc6aa666e308 req-bfca9860-c1b4-4431-a2c9-a50084f75676 service nova] Lock "ce395be4-406e-4968-82c1-915443ebb273-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-07d822eb-0939-45ba-b691-fc6aa666e308 req-bfca9860-c1b4-4431-a2c9-a50084f75676 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] No waiting events found dispatching network-vif-plugged-baeb019c-0942-4fc5-85bd-1833193e3167 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:15:09 user nova-compute[76815]: WARNING nova.compute.manager [req-07d822eb-0939-45ba-b691-fc6aa666e308 req-bfca9860-c1b4-4431-a2c9-a50084f75676 service nova] [instance: ce395be4-406e-4968-82c1-915443ebb273] Received unexpected event network-vif-plugged-baeb019c-0942-4fc5-85bd-1833193e3167 for instance with vm_state active and task_state deleting.
Nov 14 22:15:09 user nova-compute[76815]: INFO nova.compute.manager [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Took 0.89 seconds to detach 1 volumes for instance.
Nov 14 22:15:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ce395be4-406e-4968-82c1-915443ebb273] Deleting volume: c801652b-2c73-4bae-b66f-6b36db51b4c3 {{(pid=76815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 22:15:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:10 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:15:10 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:15:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:10 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Deleted allocations for instance ce395be4-406e-4968-82c1-915443ebb273
Nov 14 22:15:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f83cfee-ed15-4846-b981-ca2581d92a27 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ce395be4-406e-4968-82c1-915443ebb273" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.502s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:10 user nova-compute[76815]: INFO nova.compute.manager [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Detaching volume 4f46cd54-cd36-4cb5-ad11-694876af58ac
Nov 14 22:15:10 user nova-compute[76815]: INFO nova.virt.block_device [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Attempting to driver detach volume 4f46cd54-cd36-4cb5-ad11-694876af58ac from mountpoint /dev/vdb
Nov 14 22:15:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Attempting to detach device vdb from instance 0dc9077f-493b-44b7-bfde-1d448ae001fd from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:15:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:15:10 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:15:10 user nova-compute[76815]:   <source dev="/dev/sde"/>
Nov 14 22:15:10 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:15:10 user nova-compute[76815]:   <serial>4f46cd54-cd36-4cb5-ad11-694876af58ac</serial>
Nov 14 22:15:10 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:15:10 user nova-compute[76815]: </disk>
Nov 14 22:15:10 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:15:10 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Successfully detached device vdb from instance 0dc9077f-493b-44b7-bfde-1d448ae001fd from the persistent domain config.
Nov 14 22:15:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dc9077f-493b-44b7-bfde-1d448ae001fd from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:15:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:15:10 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:15:10 user nova-compute[76815]:   <source dev="/dev/sde"/>
Nov 14 22:15:10 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:15:10 user nova-compute[76815]:   <serial>4f46cd54-cd36-4cb5-ad11-694876af58ac</serial>
Nov 14 22:15:10 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:15:10 user nova-compute[76815]: </disk>
Nov 14 22:15:10 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:15:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dc9077f-493b-44b7-bfde-1d448ae001fd {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:15:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:15:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:15:24 user nova-compute[76815]: INFO nova.compute.claims [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Claim successful on node user
Nov 14 22:15:25 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:15:25 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:15:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:15:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:15:25 user nova-compute[76815]: DEBUG nova.network.neutron [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:15:25 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:15:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:15:25 user nova-compute[76815]: INFO nova.virt.block_device [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Booting with blank volume at /dev/vda
Nov 14 22:15:25 user nova-compute[76815]: DEBUG nova.policy [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6ef0744ff3b459b9e32404ec12bbe55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327b9fb17cb74bb0a56380b0d084cec3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:15:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:26 user nova-compute[76815]: DEBUG nova.network.neutron [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Successfully created port: 865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-da6edff7-45f5-4cf2-81f7-81e12f027aac req-98f99090-8cf8-4d9c-8d19-97641fd087ab service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received event network-changed-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-da6edff7-45f5-4cf2-81f7-81e12f027aac req-98f99090-8cf8-4d9c-8d19-97641fd087ab service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Refreshing instance network info cache due to event network-changed-4bdab381-62b2-40ae-8cd6-beab79fb7d70. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-da6edff7-45f5-4cf2-81f7-81e12f027aac req-98f99090-8cf8-4d9c-8d19-97641fd087ab service nova] Acquiring lock "refresh_cache-800a8573-b384-4919-8871-d5dbda9da3bd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-da6edff7-45f5-4cf2-81f7-81e12f027aac req-98f99090-8cf8-4d9c-8d19-97641fd087ab service nova] Acquired lock "refresh_cache-800a8573-b384-4919-8871-d5dbda9da3bd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG nova.network.neutron [req-da6edff7-45f5-4cf2-81f7-81e12f027aac req-98f99090-8cf8-4d9c-8d19-97641fd087ab service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Refreshing network info cache for port 4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Successfully updated port: 865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquired lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-72f02add-46e4-49f1-a871-fc1fcdc991e6 req-b27c0e69-fdb5-4be0-b0c6-5ae910f4ab69 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-changed-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-72f02add-46e4-49f1-a871-fc1fcdc991e6 req-b27c0e69-fdb5-4be0-b0c6-5ae910f4ab69 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Refreshing instance network info cache due to event network-changed-865be8f9-6fe3-4bed-9d06-555efe17ed6d. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72f02add-46e4-49f1-a871-fc1fcdc991e6 req-b27c0e69-fdb5-4be0-b0c6-5ae910f4ab69 service nova] Acquiring lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:15:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updating instance_info_cache with network_info: [{"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Releasing lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Instance network_info: |[{"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72f02add-46e4-49f1-a871-fc1fcdc991e6 req-b27c0e69-fdb5-4be0-b0c6-5ae910f4ab69 service nova] Acquired lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-72f02add-46e4-49f1-a871-fc1fcdc991e6 req-b27c0e69-fdb5-4be0-b0c6-5ae910f4ab69 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Refreshing network info cache for port 865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-da6edff7-45f5-4cf2-81f7-81e12f027aac req-98f99090-8cf8-4d9c-8d19-97641fd087ab service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Updated VIF entry in instance network info cache for port 4bdab381-62b2-40ae-8cd6-beab79fb7d70. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-da6edff7-45f5-4cf2-81f7-81e12f027aac req-98f99090-8cf8-4d9c-8d19-97641fd087ab service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Updating instance_info_cache with network_info: [{"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-da6edff7-45f5-4cf2-81f7-81e12f027aac req-98f99090-8cf8-4d9c-8d19-97641fd087ab service nova] Releasing lock "refresh_cache-800a8573-b384-4919-8871-d5dbda9da3bd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'flavor' on Instance uuid 800a8573-b384-4919-8871-d5dbda9da3bd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:15:28 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Ignoring supplied device name: /dev/vdb
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-72f02add-46e4-49f1-a871-fc1fcdc991e6 req-b27c0e69-fdb5-4be0-b0c6-5ae910f4ab69 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updated VIF entry in instance network info cache for port 865be8f9-6fe3-4bed-9d06-555efe17ed6d. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-72f02add-46e4-49f1-a871-fc1fcdc991e6 req-b27c0e69-fdb5-4be0-b0c6-5ae910f4ab69 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updating instance_info_cache with network_info: [{"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72f02add-46e4-49f1-a871-fc1fcdc991e6 req-b27c0e69-fdb5-4be0-b0c6-5ae910f4ab69 service nova] Releasing lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:28 user nova-compute[76815]: INFO nova.compute.manager [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Attaching volume 369b8f91-dfb1-442d-977f-24f252d5dad6 to /dev/vdb
Nov 14 22:15:28 user nova-compute[76815]: DEBUG os_brick.utils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0ab479-f9b9-4ba6-835b-532fc166cd56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb75d755-5868-4f2f-acfd-e3a7a2e4d767]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b785fb81-b336-477f-a0f9-1a8b8e5f9d61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[610531a1-5784-4830-9196-826260e39f49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:15:28 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:15:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4aa12e-b522-458c-9f9b-2659594f73fe]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG os_brick.utils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:28 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Updating existing volume attachment record: 65935b55-a4f1-4b20-b195-7aab0f8f8f59 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:15:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:31 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dc9077f-493b-44b7-bfde-1d448ae001fd is timed out.
Nov 14 22:15:31 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Successfully detached device vdb from instance 0dc9077f-493b-44b7-bfde-1d448ae001fd from the live domain config.
Nov 14 22:15:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXFZePjd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:31 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b79e72a-e818-4a57-a6e4-d51322fb8b53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:15:31 user nova-compute[76815]: No targets found.
Nov 14 22:15:31 user nova-compute[76815]: iSNS:
Nov 14 22:15:31 user nova-compute[76815]: No targets found.
Nov 14 22:15:31 user nova-compute[76815]: STATIC:
Nov 14 22:15:31 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac
Nov 14 22:15:31 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:15:31 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:15:31 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f
Nov 14 22:15:31 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:15:31 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:15:31 user nova-compute[76815]: FIRMWARE:
Nov 14 22:15:31 user nova-compute[76815]: No targets found.
Nov 14 22:15:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:15:31 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:15:31 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44bfdfb-7578-4cd0-9ebd-65cb6430a4eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.utils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c5168e-e418-44b8-ace0-3bee6bb48128]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:31 user nova-compute[76815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac (non-flash)
Nov 14 22:15:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:31 user nova-compute[76815]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac (non-flash)
Nov 14 22:15:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8396710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac'): ({'sde'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Removing single pathed devices sde {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8900bc9c-62f1-4de8-8bc9-4b4b942897ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c844942-b80a-4ed2-a6de-4eb3ad18a18e]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81132896-e4eb-452f-8b34-aef591fa20ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb753ab5-5eda-4528-b576-b641503c2427]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Flushing IO for device /dev/sde {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f2faa-7f1f-46ce-b5a3-699e3b1eab5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[11106d24-c8b5-47c9-85d7-be061fae9e49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8071eb39-c3ff-4252-a4f1-61596719dadb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:15:31 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c26d2e7-80a9-4304-a7d2-48df58f74403]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.utils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updating existing volume attachment record: 57839eef-0794-4b20-a65d-6f7abb857ac1 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ae796a-c634-4f4b-91df-1a88894799d5]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[494615c7-a34c-4a08-a985-0eebea678c03]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c8ef21-030b-46a1-8af6-14088cdb0c48]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac, portal: 172.16.0.220,3260]
Nov 14 22:15:31 user nova-compute[76815]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac, portal: 172.16.0.220,3260] successful.
Nov 14 22:15:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f46cd54-cd36-4cb5-ad11-694876af58ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f6d404-31d8-4740-965e-2f8ff76a4f96]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] <== disconnect_volume: return (387ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:15:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:32 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:32 user nova-compute[76815]: DEBUG nova.objects.instance [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'flavor' on Instance uuid 0dc9077f-493b-44b7-bfde-1d448ae001fd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:15:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9a5348ad-2396-4ad9-8b8a-8a8c1f3a2a5a tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycYvLafd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:33 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:33 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:33 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c618b2ad-280a-4d6d-8b0f-640ecec8a514]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:15:33 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9651d62-b8c0-47dd-95f8-4e4cca7dfb70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6] added
Nov 14 22:15:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[82537f36-98d2-463a-873f-26206a2d7550]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fab3e3-a11b-4b27-bf5e-9faf56f6c3ac]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycYvLafd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycYvLafd" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[49241896-0056-4350-a554-1df4b8694f01]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycYvLafd'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbda630d-ac18-4eaf-b99c-8f943ee1b1cd]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[70146046-d3c9-4435-9e42-27e419747bcd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ba6179-f2a1-447a-a408-f8e2adc8b576]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6, portal: 172.16.0.220,3260]
Nov 14 22:15:33 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6, portal: 172.16.0.220,3260] successful.
Nov 14 22:15:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[73878a06-f860-4dfe-8402-2847533bc49c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac948d3c-20bf-479f-af06-1d6c104bb345]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:33 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:33 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5741442a-07f0-4d68-aeaa-db39895aa0f6]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:15:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycYvLafd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26261383966316363', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261383966316363', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG nova.objects.instance [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'flavor' on Instance uuid 800a8573-b384-4919-8871-d5dbda9da3bd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:15:35 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:15:35 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:15:35 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:15:35 user nova-compute[76815]:   <serial>369b8f91-dfb1-442d-977f-24f252d5dad6</serial>
Nov 14 22:15:35 user nova-compute[76815]: </disk>
Nov 14 22:15:35 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No VIF found with MAC fa:16:3e:99:7f:3a, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fbcd4e15-0d4c-4c58-a805-aa4d12dc3e9f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.201s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:15:36 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Creating image(s)
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Ensure instance console log exists: /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Start _get_guest_xml network_info=[{"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMaLtgSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ba89777-a1fe-4754-9f3b-4e7a2daaa550', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3bfd852-1215-49c7-81ef-eea070001bbd', 'serial': 'b3bfd852-1215-49c7-81ef-eea070001bbd'}, 'attachment_id': '57839eef-0794-4b20-a65d-6f7abb857ac1', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:15:36 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:15:36 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMaLtgSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:36 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:36 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:36 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9083683b-5245-4dab-8737-6264aeb44d74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:15:36 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[69635b1c-9873-4d29-bee4-4bda3f18d376]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd] added
Nov 14 22:15:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f485cd7-56c1-4ab4-8128-132b1699d7c0]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28e6caa-7724-41aa-b1ce-97d12407f8c2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMaLtgSs {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMaLtgSs" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b82082-9ec9-4aef-b037-5f23840d835d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xMaLtgSs'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7978a405-83c3-4f5e-b0e2-ce056fae66bc]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9d246b-6cdb-4ebb-9d8a-41198c058ba3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:36 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:36 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[846e5c7c-e05a-427f-9bd6-e7bdb5ef3897]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd, portal: 172.16.0.220,3260]
Nov 14 22:15:36 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd, portal: 172.16.0.220,3260] successful.
Nov 14 22:15:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0085bfc-3959-4ec6-a490-abdb2b322e11]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b3486f-5a78-4d0b-9c47-6c83e306148f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:36 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:36 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:36 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:36 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cabf17e-eb5b-4cf0-9e07-c62c91367f0b]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:15:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMaLtgSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:37 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:15:37 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7683MB free_disk=25.291622161865234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bb235db0-61d3-4e29-9794-b7c181f074d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0dc9077f-493b-44b7-bfde-1d448ae001fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 800a8573-b384-4919-8871-d5dbda9da3bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance df6f5090-eb0a-49b6-8e6c-e46475f7c784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bc3a520b-21e4-463e-a39d-a397c3e6b811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26330646530386235', 'path': '/dev/sdd'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330646530386235', 'path': '/dev/sdd'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 648e61c3-1925-4e22-8dc7-3bd8c0558487 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163209102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163209102',id=23,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-lgqcxfxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:15:26Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=0ba89777-a1fe-4754-9f3b-4e7a2daaa550,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:73:ea,bridge_name='br-int',has_traffic_filtering=True,id=865be8f9-6fe3-4bed-9d06-555efe17ed6d,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865be8f9-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.objects.instance [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:15:38 user nova-compute[76815]:   <uuid>0ba89777-a1fe-4754-9f3b-4e7a2daaa550</uuid>
Nov 14 22:15:38 user nova-compute[76815]:   <name>instance-00000017</name>
Nov 14 22:15:38 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:15:38 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:15:38 user nova-compute[76815]:   <metadata>
Nov 14 22:15:38 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:15:38 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:15:38 user nova-compute[76815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1163209102</nova:name>
Nov 14 22:15:38 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:15:36</nova:creationTime>
Nov 14 22:15:38 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:15:38 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:15:38 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:15:38 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:15:38 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:15:38 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:15:38 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:15:38 user nova-compute[76815]:       <nova:owner>
Nov 14 22:15:38 user nova-compute[76815]:         <nova:user uuid="a6ef0744ff3b459b9e32404ec12bbe55">tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member</nova:user>
Nov 14 22:15:38 user nova-compute[76815]:         <nova:project uuid="327b9fb17cb74bb0a56380b0d084cec3">tempest-ServerBootFromVolumeStableRescueTest-890378304</nova:project>
Nov 14 22:15:38 user nova-compute[76815]:       </nova:owner>
Nov 14 22:15:38 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:15:38 user nova-compute[76815]:       <nova:ports>
Nov 14 22:15:38 user nova-compute[76815]:         <nova:port uuid="865be8f9-6fe3-4bed-9d06-555efe17ed6d">
Nov 14 22:15:38 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 22:15:38 user nova-compute[76815]:         </nova:port>
Nov 14 22:15:38 user nova-compute[76815]:       </nova:ports>
Nov 14 22:15:38 user nova-compute[76815]:     </nova:instance>
Nov 14 22:15:38 user nova-compute[76815]:   </metadata>
Nov 14 22:15:38 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:15:38 user nova-compute[76815]:     <system>
Nov 14 22:15:38 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:15:38 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:15:38 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:15:38 user nova-compute[76815]:       <entry name="serial">0ba89777-a1fe-4754-9f3b-4e7a2daaa550</entry>
Nov 14 22:15:38 user nova-compute[76815]:       <entry name="uuid">0ba89777-a1fe-4754-9f3b-4e7a2daaa550</entry>
Nov 14 22:15:38 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:15:38 user nova-compute[76815]:     </system>
Nov 14 22:15:38 user nova-compute[76815]:   </sysinfo>
Nov 14 22:15:38 user nova-compute[76815]:   <os>
Nov 14 22:15:38 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:15:38 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:15:38 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:15:38 user nova-compute[76815]:   </os>
Nov 14 22:15:38 user nova-compute[76815]:   <features>
Nov 14 22:15:38 user nova-compute[76815]:     <acpi/>
Nov 14 22:15:38 user nova-compute[76815]:     <apic/>
Nov 14 22:15:38 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:15:38 user nova-compute[76815]:   </features>
Nov 14 22:15:38 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:15:38 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:15:38 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:15:38 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:15:38 user nova-compute[76815]:   </clock>
Nov 14 22:15:38 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:15:38 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:15:38 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:15:38 user nova-compute[76815]:   </cpu>
Nov 14 22:15:38 user nova-compute[76815]:   <devices>
Nov 14 22:15:38 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:15:38 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:15:38 user nova-compute[76815]:       <source dev="/dev/sdd"/>
Nov 14 22:15:38 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:15:38 user nova-compute[76815]:       <serial>b3bfd852-1215-49c7-81ef-eea070001bbd</serial>
Nov 14 22:15:38 user nova-compute[76815]:     </disk>
Nov 14 22:15:38 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:15:38 user nova-compute[76815]:       <mac address="fa:16:3e:42:73:ea"/>
Nov 14 22:15:38 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:15:38 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:15:38 user nova-compute[76815]:       <target dev="tap865be8f9-6f"/>
Nov 14 22:15:38 user nova-compute[76815]:     </interface>
Nov 14 22:15:38 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:15:38 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/console.log" append="off"/>
Nov 14 22:15:38 user nova-compute[76815]:     </serial>
Nov 14 22:15:38 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:15:38 user nova-compute[76815]:     <video>
Nov 14 22:15:38 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:15:38 user nova-compute[76815]:     </video>
Nov 14 22:15:38 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:15:38 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:15:38 user nova-compute[76815]:     </rng>
Nov 14 22:15:38 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:15:38 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:15:38 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:15:38 user nova-compute[76815]:     </memballoon>
Nov 14 22:15:38 user nova-compute[76815]:   </devices>
Nov 14 22:15:38 user nova-compute[76815]: </domain>
Nov 14 22:15:38 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163209102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163209102',id=23,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-lgqcxfxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:15:26Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=0ba89777-a1fe-4754-9f3b-4e7a2daaa550,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:73:ea,bridge_name='br-int',has_traffic_filtering=True,id=865be8f9-6fe3-4bed-9d06-555efe17ed6d,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865be8f9-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG os_vif [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:73:ea,bridge_name='br-int',has_traffic_filtering=True,id=865be8f9-6fe3-4bed-9d06-555efe17ed6d,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865be8f9-6f') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e314ce8-9150-5264-8573-68ad4d56de9b', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap865be8f9-6f, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap865be8f9-6f, col_values=(('qos', UUID('2ed4724d-1a86-42dc-8751-6db5da099e46')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap865be8f9-6f, col_values=(('external_ids', {'iface-id': '865be8f9-6fe3-4bed-9d06-555efe17ed6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:73:ea', 'vm-uuid': '0ba89777-a1fe-4754-9f3b-4e7a2daaa550'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:38 user nova-compute[76815]: INFO os_vif [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:73:ea,bridge_name='br-int',has_traffic_filtering=True,id=865be8f9-6fe3-4bed-9d06-555efe17ed6d,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865be8f9-6f')
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No VIF found with MAC fa:16:3e:42:73:ea, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.483s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:15:38 user nova-compute[76815]: INFO nova.compute.claims [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Claim successful on node user
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:15:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:15:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:15:39 user nova-compute[76815]: INFO nova.virt.block_device [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Booting with volume b98fed93-15d7-4f20-8532-1b940ef1834d at /dev/vda
Nov 14 22:15:39 user nova-compute[76815]: DEBUG nova.policy [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6735de275f141f5af89c22bc21adf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16d1e69321814403a08c9fe1a8b513c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG os_brick.utils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acf4760-4203-48eb-9855-95b8ca4b6853]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d69bb0-b696-4b6d-9a3e-97d270862994]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[65094695-fba0-4866-bdd6-09f54dfaac51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffec275-f515-4ce3-b586-3fde59ff1647]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:15:39 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8746c9a-2713-44a9-b193-bf83bf68ce48]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG os_brick.utils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating existing volume attachment record: eb69a92f-f3d4-4b8d-b244-d2d6df64cf79 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-7f793c2a-4f6e-4e57-9c32-fb8d22f0de16 req-5b3ce412-6733-48a9-bd56-fbf39dbd0810 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7f793c2a-4f6e-4e57-9c32-fb8d22f0de16 req-5b3ce412-6733-48a9-bd56-fbf39dbd0810 service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7f793c2a-4f6e-4e57-9c32-fb8d22f0de16 req-5b3ce412-6733-48a9-bd56-fbf39dbd0810 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7f793c2a-4f6e-4e57-9c32-fb8d22f0de16 req-5b3ce412-6733-48a9-bd56-fbf39dbd0810 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-7f793c2a-4f6e-4e57-9c32-fb8d22f0de16 req-5b3ce412-6733-48a9-bd56-fbf39dbd0810 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:15:39 user nova-compute[76815]: WARNING nova.compute.manager [req-7f793c2a-4f6e-4e57-9c32-fb8d22f0de16 req-5b3ce412-6733-48a9-bd56-fbf39dbd0810 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state building and task_state spawning.
Nov 14 22:15:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Successfully created port: cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updating instance_info_cache with network_info: [{"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Successfully updated port: cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquired lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3412eae-5934-4e48-8f74-dfc26449cf26 req-24dd8866-e6ed-47cd-8c00-3052359a637e service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-changed-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3412eae-5934-4e48-8f74-dfc26449cf26 req-24dd8866-e6ed-47cd-8c00-3052359a637e service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Refreshing instance network info cache due to event network-changed-cb3956f2-83bd-4ad2-a094-05a0c983a4a2. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3412eae-5934-4e48-8f74-dfc26449cf26 req-24dd8866-e6ed-47cd-8c00-3052359a637e service nova] Acquiring lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:15:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating instance_info_cache with network_info: [{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Releasing lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Instance network_info: |[{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3412eae-5934-4e48-8f74-dfc26449cf26 req-24dd8866-e6ed-47cd-8c00-3052359a637e service nova] Acquired lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.network.neutron [req-e3412eae-5934-4e48-8f74-dfc26449cf26 req-24dd8866-e6ed-47cd-8c00-3052359a637e service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Refreshing network info cache for port cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.network.neutron [req-e3412eae-5934-4e48-8f74-dfc26449cf26 req-24dd8866-e6ed-47cd-8c00-3052359a637e service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updated VIF entry in instance network info cache for port cb3956f2-83bd-4ad2-a094-05a0c983a4a2. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.network.neutron [req-e3412eae-5934-4e48-8f74-dfc26449cf26 req-24dd8866-e6ed-47cd-8c00-3052359a637e service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating instance_info_cache with network_info: [{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3412eae-5934-4e48-8f74-dfc26449cf26 req-24dd8866-e6ed-47cd-8c00-3052359a637e service nova] Releasing lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-6e91c101-ad11-4f25-8b04-27ff42a6b6e4 req-c496ecf6-dc91-420e-b892-eaddaf69520d service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6e91c101-ad11-4f25-8b04-27ff42a6b6e4 req-c496ecf6-dc91-420e-b892-eaddaf69520d service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6e91c101-ad11-4f25-8b04-27ff42a6b6e4 req-c496ecf6-dc91-420e-b892-eaddaf69520d service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6e91c101-ad11-4f25-8b04-27ff42a6b6e4 req-c496ecf6-dc91-420e-b892-eaddaf69520d service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-6e91c101-ad11-4f25-8b04-27ff42a6b6e4 req-c496ecf6-dc91-420e-b892-eaddaf69520d service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:15:41 user nova-compute[76815]: WARNING nova.compute.manager [req-6e91c101-ad11-4f25-8b04-27ff42a6b6e4 req-c496ecf6-dc91-420e-b892-eaddaf69520d service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state building and task_state spawning.
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:15:41 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Instance spawned successfully.
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:41 user nova-compute[76815]: INFO nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 14 22:15:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:15:42 user nova-compute[76815]: INFO nova.compute.manager [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Took 17.32 seconds to build instance.
Nov 14 22:15:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1014552c-2e4d-41eb-9004-580edfa6144d tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.456s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:43 user nova-compute[76815]: INFO nova.compute.manager [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Detaching volume 369b8f91-dfb1-442d-977f-24f252d5dad6
Nov 14 22:15:44 user nova-compute[76815]: INFO nova.virt.block_device [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Attempting to driver detach volume 369b8f91-dfb1-442d-977f-24f252d5dad6 from mountpoint /dev/vdb
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Attempting to detach device vdb from instance 800a8573-b384-4919-8871-d5dbda9da3bd from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:15:44 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:15:44 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:15:44 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:15:44 user nova-compute[76815]:   <serial>369b8f91-dfb1-442d-977f-24f252d5dad6</serial>
Nov 14 22:15:44 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:15:44 user nova-compute[76815]: </disk>
Nov 14 22:15:44 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:15:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Successfully detached device vdb from instance 800a8573-b384-4919-8871-d5dbda9da3bd from the persistent domain config.
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 800a8573-b384-4919-8871-d5dbda9da3bd from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:15:44 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:15:44 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:15:44 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:15:44 user nova-compute[76815]:   <serial>369b8f91-dfb1-442d-977f-24f252d5dad6</serial>
Nov 14 22:15:44 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:15:44 user nova-compute[76815]: </disk>
Nov 14 22:15:44 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:15:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Creating image(s)
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Ensure instance console log exists: /opt/stack/data/nova/instances/648e61c3-1925-4e22-8dc7-3bd8c0558487/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Start _get_guest_xml network_info=[{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avQAsjSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '648e61c3-1925-4e22-8dc7-3bd8c0558487', 'attached_at': '', 'detached_at': '', 'volume_id': 'b98fed93-15d7-4f20-8532-1b940ef1834d', 'serial': 'b98fed93-15d7-4f20-8532-1b940ef1834d'}, 'attachment_id': 'eb69a92f-f3d4-4b8d-b244-d2d6df64cf79', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:15:44 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:15:44 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avQAsjSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:44 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:44 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:44 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e609a78b-f6f6-4937-be13-8aa6dbc78454]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:15:44 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e00b57-6571-410a-b86e-842b3d67f495]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d] added
Nov 14 22:15:44 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7ac0a5-7c55-48b9-87d0-36acad9b6bfa]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a9c1f4-73a5-4b7c-a348-aca7a6ed6110]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avQAsjSN {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avQAsjSN" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a877fd2d-3248-422b-a1b5-a93bc207835f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'avQAsjSN'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 800a8573-b384-4919-8871-d5dbda9da3bd {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bc3d60-f15e-4a6e-b3f6-dc15292b8325]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d220ec-c622-40b4-9eab-3b42c7571a3e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:44 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:44 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a781fe74-4796-4639-93ca-71d04280a1b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260]
Nov 14 22:15:44 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260] successful.
Nov 14 22:15:44 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b7041a-1065-4a3e-939a-944687f18b37]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da98b56-b03e-4866-9f46-91eafa8d589a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:15:44 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:44 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:15:44 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0b6198-25c7-4d6a-9b47-f551d4323d38]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:44 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avQAsjSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26265353430633265', 'path': '/dev/sde'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265353430633265', 'path': '/dev/sde'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1645877840',display_name='tempest-TestShelveInstance-server-1645877840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1645877840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGRF3tZ5vukvGSPGaBbMdr+SLUVCiZZp9isJCMdELcILWbk/VZ5BcYT6poET5qWmdB/8GE0Jrkl3uFLur8pBS+W+3d5igXmBtRLCmzA+Z0WsC9rpzTa0JYgzqcTz+654Q==',key_name='tempest-TestShelveInstance-731084026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16d1e69321814403a08c9fe1a8b513c5',ramdisk_id='',reservation_id='r-cz2nxg7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1419119597',owner_user_name='tempest-TestShelveInstance-1419119597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:15:39Z,user_data=None,user_id='b6735de275f141f5af89c22bc21adf95',uuid=648e61c3-1925-4e22-8dc7-3bd8c0558487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converting VIF {"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.objects.instance [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lazy-loading 'pci_devices' on Instance uuid 648e61c3-1925-4e22-8dc7-3bd8c0558487 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:15:45 user nova-compute[76815]:   <uuid>648e61c3-1925-4e22-8dc7-3bd8c0558487</uuid>
Nov 14 22:15:45 user nova-compute[76815]:   <name>instance-00000018</name>
Nov 14 22:15:45 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:15:45 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:15:45 user nova-compute[76815]:   <metadata>
Nov 14 22:15:45 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:15:45 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:15:45 user nova-compute[76815]:       <nova:name>tempest-TestShelveInstance-server-1645877840</nova:name>
Nov 14 22:15:45 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:15:44</nova:creationTime>
Nov 14 22:15:45 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:15:45 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:15:45 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:15:45 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:15:45 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:15:45 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:15:45 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:15:45 user nova-compute[76815]:       <nova:owner>
Nov 14 22:15:45 user nova-compute[76815]:         <nova:user uuid="b6735de275f141f5af89c22bc21adf95">tempest-TestShelveInstance-1419119597-project-member</nova:user>
Nov 14 22:15:45 user nova-compute[76815]:         <nova:project uuid="16d1e69321814403a08c9fe1a8b513c5">tempest-TestShelveInstance-1419119597</nova:project>
Nov 14 22:15:45 user nova-compute[76815]:       </nova:owner>
Nov 14 22:15:45 user nova-compute[76815]:       <nova:ports>
Nov 14 22:15:45 user nova-compute[76815]:         <nova:port uuid="cb3956f2-83bd-4ad2-a094-05a0c983a4a2">
Nov 14 22:15:45 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 22:15:45 user nova-compute[76815]:         </nova:port>
Nov 14 22:15:45 user nova-compute[76815]:       </nova:ports>
Nov 14 22:15:45 user nova-compute[76815]:     </nova:instance>
Nov 14 22:15:45 user nova-compute[76815]:   </metadata>
Nov 14 22:15:45 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:15:45 user nova-compute[76815]:     <system>
Nov 14 22:15:45 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:15:45 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:15:45 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:15:45 user nova-compute[76815]:       <entry name="serial">648e61c3-1925-4e22-8dc7-3bd8c0558487</entry>
Nov 14 22:15:45 user nova-compute[76815]:       <entry name="uuid">648e61c3-1925-4e22-8dc7-3bd8c0558487</entry>
Nov 14 22:15:45 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:15:45 user nova-compute[76815]:     </system>
Nov 14 22:15:45 user nova-compute[76815]:   </sysinfo>
Nov 14 22:15:45 user nova-compute[76815]:   <os>
Nov 14 22:15:45 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:15:45 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:15:45 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:15:45 user nova-compute[76815]:   </os>
Nov 14 22:15:45 user nova-compute[76815]:   <features>
Nov 14 22:15:45 user nova-compute[76815]:     <acpi/>
Nov 14 22:15:45 user nova-compute[76815]:     <apic/>
Nov 14 22:15:45 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:15:45 user nova-compute[76815]:   </features>
Nov 14 22:15:45 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:15:45 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:15:45 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:15:45 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:15:45 user nova-compute[76815]:   </clock>
Nov 14 22:15:45 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:15:45 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:15:45 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:15:45 user nova-compute[76815]:   </cpu>
Nov 14 22:15:45 user nova-compute[76815]:   <devices>
Nov 14 22:15:45 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:15:45 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:15:45 user nova-compute[76815]:       <source dev="/dev/sde"/>
Nov 14 22:15:45 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:15:45 user nova-compute[76815]:       <serial>b98fed93-15d7-4f20-8532-1b940ef1834d</serial>
Nov 14 22:15:45 user nova-compute[76815]:     </disk>
Nov 14 22:15:45 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:15:45 user nova-compute[76815]:       <mac address="fa:16:3e:ac:55:32"/>
Nov 14 22:15:45 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:15:45 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:15:45 user nova-compute[76815]:       <target dev="tapcb3956f2-83"/>
Nov 14 22:15:45 user nova-compute[76815]:     </interface>
Nov 14 22:15:45 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:15:45 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/648e61c3-1925-4e22-8dc7-3bd8c0558487/console.log" append="off"/>
Nov 14 22:15:45 user nova-compute[76815]:     </serial>
Nov 14 22:15:45 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:15:45 user nova-compute[76815]:     <video>
Nov 14 22:15:45 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:15:45 user nova-compute[76815]:     </video>
Nov 14 22:15:45 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:15:45 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:15:45 user nova-compute[76815]:     </rng>
Nov 14 22:15:45 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:15:45 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:15:45 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:15:45 user nova-compute[76815]:     </memballoon>
Nov 14 22:15:45 user nova-compute[76815]:   </devices>
Nov 14 22:15:45 user nova-compute[76815]: </domain>
Nov 14 22:15:45 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1645877840',display_name='tempest-TestShelveInstance-server-1645877840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1645877840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGRF3tZ5vukvGSPGaBbMdr+SLUVCiZZp9isJCMdELcILWbk/VZ5BcYT6poET5qWmdB/8GE0Jrkl3uFLur8pBS+W+3d5igXmBtRLCmzA+Z0WsC9rpzTa0JYgzqcTz+654Q==',key_name='tempest-TestShelveInstance-731084026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16d1e69321814403a08c9fe1a8b513c5',ramdisk_id='',reservation_id='r-cz2nxg7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1419119597',owner_user_name='tempest-TestShelveInstance-1419119597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:15:39Z,user_data=None,user_id='b6735de275f141f5af89c22bc21adf95',uuid=648e61c3-1925-4e22-8dc7-3bd8c0558487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converting VIF {"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG os_vif [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b40b6b06-923a-508a-a517-b85d5e35bd08', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb3956f2-83, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb3956f2-83, col_values=(('qos', UUID('18f3ed36-b2cb-40db-95a4-b6b89d470334')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb3956f2-83, col_values=(('external_ids', {'iface-id': 'cb3956f2-83bd-4ad2-a094-05a0c983a4a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:55:32', 'vm-uuid': '648e61c3-1925-4e22-8dc7-3bd8c0558487'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:45 user nova-compute[76815]: INFO os_vif [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83')
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:15:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] No VIF found with MAC fa:16:3e:ac:55:32, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:15:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4676327-260f-465d-973f-a6a1e4e0c404 req-efcd6123-f7dc-48b7-b2ac-4c514e5469d1 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4676327-260f-465d-973f-a6a1e4e0c404 req-efcd6123-f7dc-48b7-b2ac-4c514e5469d1 service nova] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4676327-260f-465d-973f-a6a1e4e0c404 req-efcd6123-f7dc-48b7-b2ac-4c514e5469d1 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b4676327-260f-465d-973f-a6a1e4e0c404 req-efcd6123-f7dc-48b7-b2ac-4c514e5469d1 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-b4676327-260f-465d-973f-a6a1e4e0c404 req-efcd6123-f7dc-48b7-b2ac-4c514e5469d1 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] No waiting events found dispatching network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:15:47 user nova-compute[76815]: WARNING nova.compute.manager [req-b4676327-260f-465d-973f-a6a1e4e0c404 req-efcd6123-f7dc-48b7-b2ac-4c514e5469d1 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received unexpected event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 for instance with vm_state building and task_state spawning.
Nov 14 22:15:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:15:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Instance spawned successfully.
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] No waiting events found dispatching network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:15:49 user nova-compute[76815]: WARNING nova.compute.manager [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received unexpected event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 for instance with vm_state building and task_state spawning.
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received event network-changed-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Refreshing instance network info cache due to event network-changed-7775a114-c778-45fb-b919-c1fb32485bf6. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] Acquiring lock "refresh_cache-df6f5090-eb0a-49b6-8e6c-e46475f7c784" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] Acquired lock "refresh_cache-df6f5090-eb0a-49b6-8e6c-e46475f7c784" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.network.neutron [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Refreshing network info cache for port 7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:15:49 user nova-compute[76815]: INFO nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 14 22:15:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:15:49 user nova-compute[76815]: INFO nova.compute.manager [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Took 11.74 seconds to build instance.
Nov 14 22:15:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d7265119-bcf2-4a6b-bc3b-9eac790cf192 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.847s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG nova.network.neutron [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Updated VIF entry in instance network info cache for port 7775a114-c778-45fb-b919-c1fb32485bf6. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG nova.network.neutron [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Updating instance_info_cache with network_info: [{"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45be5d6b-ae1e-4509-a175-cca0dd9f17d0 req-7933a3cb-9269-493b-a6da-4a384fb4bbaf service nova] Releasing lock "refresh_cache-df6f5090-eb0a-49b6-8e6c-e46475f7c784" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG nova.objects.instance [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lazy-loading 'flavor' on Instance uuid df6f5090-eb0a-49b6-8e6c-e46475f7c784 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:15:50 user nova-compute[76815]: INFO nova.compute.manager [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Attaching volume 285228a8-2ddc-4f64-9eb4-27326cd0bd29 to /dev/vdb
Nov 14 22:15:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG os_brick.utils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1692b05f-b301-4d9b-b3fb-1c60b2d5bbd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dabef38-95f1-4f08-b63d-3b4f876c75c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4773515e-e65e-4167-a578-5dcd86eaeb86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2a2741-7c83-4d99-a214-fccad6a1a3ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:15:51 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:15:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e7636e-1718-41c3-a496-8d487b5124d9]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG os_brick.utils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Updating existing volume attachment record: 0afa535b-8e02-434a-bba8-2e58a13c6c15 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:15:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnEXcRFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:15:55 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:55 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:15:55 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c07d2fc-f059-4e5b-84c2-028defd4f472]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:15:55 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9acccf-66f7-4a28-a548-f56b1d350a85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29] added
Nov 14 22:15:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f690447-62e1-4855-9f72-078d1a3e3766]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c828715-8068-487a-8919-6377f9cc88ea]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnEXcRFt {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bnEXcRFt" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d20d35-b933-41a2-a3c2-be5388c67ba7]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bnEXcRFt'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f132920b-af41-4f17-ae36-0d49f113c1c1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8181e14-d157-4965-8c27-1cb844e2d115]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:55 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:55 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:55 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:15:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:55 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:55 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:55 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:15:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7328cdc4-cf4f-4ccc-8fae-fc4526bb1197]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29, portal: 172.16.0.220,3260]
Nov 14 22:15:55 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29, portal: 172.16.0.220,3260] successful.
Nov 14 22:15:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cfd9d8-bc79-47b1-8876-d5e2dd292aa0]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[339ef754-1a51-45e2-8e24-d464d0371eae]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:56 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:56 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:56 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:15:56 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:15:56 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:15:56 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:15:56 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:15:56 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:15:56 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:15:56 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[535d782d-c287-44ca-ba30-b8038e8adabf]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:15:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnEXcRFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26461326165363238', 'path': '/dev/sdf'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461326165363238', 'path': '/dev/sdf'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG nova.objects.instance [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lazy-loading 'flavor' on Instance uuid df6f5090-eb0a-49b6-8e6c-e46475f7c784 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:15:57 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:15:57 user nova-compute[76815]:   <source dev="/dev/sdf"/>
Nov 14 22:15:57 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:15:57 user nova-compute[76815]:   <serial>285228a8-2ddc-4f64-9eb4-27326cd0bd29</serial>
Nov 14 22:15:57 user nova-compute[76815]: </disk>
Nov 14 22:15:57 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] No VIF found with MAC fa:16:3e:65:4e:33, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:15:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-03763c1b-a0e5-4cce-83c8-8ad4b875ffb8 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.815s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:00 user nova-compute[76815]: INFO nova.compute.manager [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Detaching volume 285228a8-2ddc-4f64-9eb4-27326cd0bd29
Nov 14 22:16:00 user nova-compute[76815]: INFO nova.virt.block_device [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Attempting to driver detach volume 285228a8-2ddc-4f64-9eb4-27326cd0bd29 from mountpoint /dev/vdb
Nov 14 22:16:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Attempting to detach device vdb from instance df6f5090-eb0a-49b6-8e6c-e46475f7c784 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:16:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:16:00 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:16:00 user nova-compute[76815]:   <source dev="/dev/sdf"/>
Nov 14 22:16:00 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:16:00 user nova-compute[76815]:   <serial>285228a8-2ddc-4f64-9eb4-27326cd0bd29</serial>
Nov 14 22:16:00 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:16:00 user nova-compute[76815]: </disk>
Nov 14 22:16:00 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:16:00 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Successfully detached device vdb from instance df6f5090-eb0a-49b6-8e6c-e46475f7c784 from the persistent domain config.
Nov 14 22:16:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df6f5090-eb0a-49b6-8e6c-e46475f7c784 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:16:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:16:00 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:16:00 user nova-compute[76815]:   <source dev="/dev/sdf"/>
Nov 14 22:16:00 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:16:00 user nova-compute[76815]:   <serial>285228a8-2ddc-4f64-9eb4-27326cd0bd29</serial>
Nov 14 22:16:00 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:16:00 user nova-compute[76815]: </disk>
Nov 14 22:16:00 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:16:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df6f5090-eb0a-49b6-8e6c-e46475f7c784 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:16:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:16:03 user nova-compute[76815]: INFO nova.compute.manager [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] instance snapshotting
Nov 14 22:16:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Beginning live snapshot process
Nov 14 22:16:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json -f qcow2 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json -f qcow2 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsuro9m17/803c85cd87004f03bb9d5afcf0e3d61a.delta 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsuro9m17/803c85cd87004f03bb9d5afcf0e3d61a.delta 1073741824" returned: 0 in 0.087s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 22:16:04 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 800a8573-b384-4919-8871-d5dbda9da3bd is timed out.
Nov 14 22:16:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Successfully detached device vdb from instance 800a8573-b384-4919-8871-d5dbda9da3bd from the live domain config.
Nov 14 22:16:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycYvLafd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:04 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e9ec3b-d088-4d80-94c2-27ceea068ac4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:16:04 user nova-compute[76815]: No targets found.
Nov 14 22:16:04 user nova-compute[76815]: iSNS:
Nov 14 22:16:04 user nova-compute[76815]: No targets found.
Nov 14 22:16:04 user nova-compute[76815]: STATIC:
Nov 14 22:16:04 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:16:04 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:04 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:04 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:16:04 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:04 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:04 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29
Nov 14 22:16:04 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:04 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:04 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f
Nov 14 22:16:04 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:04 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:04 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6
Nov 14 22:16:04 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:04 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:04 user nova-compute[76815]: FIRMWARE:
Nov 14 22:16:04 user nova-compute[76815]: No targets found.
Nov 14 22:16:04 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:16:04 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:16:04 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ad9413-4528-425c-971b-50a5a802e588]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b96040-0185-439b-b60f-3791058c8b5c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:04 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:16:04 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:04 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:04 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:04 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:04 user nova-compute[76815]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 (non-flash)
Nov 14 22:16:04 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:04 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:04 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:04 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4776710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c41b45-c35a-4408-ac97-b3e09d5f3ad3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a518293-c441-4474-8fd9-1639ea0c88b7]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457ec32-f5ec-434f-9f79-9498b385dbce]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.088s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dacbb3-dce7-4ce0-aa24-b7c790b4c661]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[239c0719-f6f5-4c93-a754-8a7431c2bd75]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c462f5-310d-4ca0-95b5-943db385c5cd]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6, portal: 172.16.0.220,3260]
Nov 14 22:16:05 user nova-compute[76815]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6, portal: 172.16.0.220,3260] successful.
Nov 14 22:16:05 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d7703-647b-430f-8510-0b8a8426dc3d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] <== disconnect_volume: return (411ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:16:05 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 22:16:05 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsuro9m17/803c85cd87004f03bb9d5afcf0e3d61a.delta /opt/stack/data/nova/instances/snapshots/tmpsuro9m17/803c85cd87004f03bb9d5afcf0e3d61a {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsuro9m17/803c85cd87004f03bb9d5afcf0e3d61a.delta /opt/stack/data/nova/instances/snapshots/tmpsuro9m17/803c85cd87004f03bb9d5afcf0e3d61a" returned: 0 in 0.260s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:05 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Snapshot extracted, beginning image upload
Nov 14 22:16:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG nova.objects.instance [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'flavor' on Instance uuid 800a8573-b384-4919-8871-d5dbda9da3bd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-76777703-b903-4e8e-8b8b-46c4d615f31d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.026s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.891s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:06 user nova-compute[76815]: INFO nova.compute.manager [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Terminating instance
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.compute.manager [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-def3529f-8707-40d8-9278-716d6993d6ff req-07a91ca6-c1dc-4549-a37a-3cf928cb9510 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received event network-vif-unplugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-def3529f-8707-40d8-9278-716d6993d6ff req-07a91ca6-c1dc-4549-a37a-3cf928cb9510 service nova] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-def3529f-8707-40d8-9278-716d6993d6ff req-07a91ca6-c1dc-4549-a37a-3cf928cb9510 service nova] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-def3529f-8707-40d8-9278-716d6993d6ff req-07a91ca6-c1dc-4549-a37a-3cf928cb9510 service nova] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-def3529f-8707-40d8-9278-716d6993d6ff req-07a91ca6-c1dc-4549-a37a-3cf928cb9510 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] No waiting events found dispatching network-vif-unplugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-def3529f-8707-40d8-9278-716d6993d6ff req-07a91ca6-c1dc-4549-a37a-3cf928cb9510 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received event network-vif-unplugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "59178f91-5932-41b5-9e21-7c2401be86ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:16:06 user nova-compute[76815]: INFO nova.compute.claims [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Claim successful on node user
Nov 14 22:16:06 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Instance destroyed successfully.
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'resources' on Instance uuid 800a8573-b384-4919-8871-d5dbda9da3bd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-689959966',display_name='tempest-VolumesSnapshotTestJSON-instance-689959966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-689959966',id=20,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDnRb/n5U1yiSeg/OdEJ4hDr4hZBvgL3/KEHZzWgb01eIZsJs2EzL+eHlyzGYBPVTQ5WRV5QAvrFsEsgqMKCdJ5taodx7bTUabyXA3OPOA4u3ei1XhOs2UE+7j8y2jwVQ==',key_name='tempest-keypair-2123050463',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:13:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47a8307d87eb4927b49944f0a0055ef1',ramdisk_id='',reservation_id='r-cg1wpuhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1321856389',owner_user_name='tempest-VolumesSnapshotTestJSON-1321856389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c67499628cb4369bc042f00b6a4303b',uuid=800a8573-b384-4919-8871-d5dbda9da3bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converting VIF {"id": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "address": "fa:16:3e:99:7f:3a", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bdab381-62", "ovs_interfaceid": "4bdab381-62b2-40ae-8cd6-beab79fb7d70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:7f:3a,bridge_name='br-int',has_traffic_filtering=True,id=4bdab381-62b2-40ae-8cd6-beab79fb7d70,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bdab381-62') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG os_vif [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:7f:3a,bridge_name='br-int',has_traffic_filtering=True,id=4bdab381-62b2-40ae-8cd6-beab79fb7d70,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bdab381-62') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bdab381-62, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9c50112-9133-415c-b16e-70b989449fc5) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:07 user nova-compute[76815]: INFO os_vif [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:7f:3a,bridge_name='br-int',has_traffic_filtering=True,id=4bdab381-62b2-40ae-8cd6-beab79fb7d70,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bdab381-62')
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycYvLafd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:07 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9428cce-0e01-4d3e-b229-63875f55cde7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:16:07 user nova-compute[76815]: No targets found.
Nov 14 22:16:07 user nova-compute[76815]: iSNS:
Nov 14 22:16:07 user nova-compute[76815]: No targets found.
Nov 14 22:16:07 user nova-compute[76815]: STATIC:
Nov 14 22:16:07 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:16:07 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:07 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:07 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:16:07 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:07 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:07 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29
Nov 14 22:16:07 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:07 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:07 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f
Nov 14 22:16:07 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:07 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:07 user nova-compute[76815]: FIRMWARE:
Nov 14 22:16:07 user nova-compute[76815]: No targets found.
Nov 14 22:16:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:16:07 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:16:07 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369b8f91-dfb1-442d-977f-24f252d5dad6', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[45debf6e-beb7-42ef-b3cb-1da6b7b46a3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df834f3-a6cf-48f2-90cc-3894d9d78cc2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:07 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:07 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:07 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:07 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:07 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:07 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a477e8c0>, {}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Disconnecting from: [] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] <== disconnect_volume: return (83ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:16:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Deleting instance files /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd_del
Nov 14 22:16:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Deletion of /opt/stack/data/nova/instances/800a8573-b384-4919-8871-d5dbda9da3bd_del complete
Nov 14 22:16:07 user nova-compute[76815]: INFO nova.compute.manager [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.network.neutron [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:16:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.policy [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd5c7c940b0429994db55b93cb421ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673708a9f12541f6929c86eb60ca83c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:16:07 user nova-compute[76815]: INFO nova.virt.block_device [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Booting with volume e8687df9-9d10-453e-b043-566948973a21 at /dev/vda
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.utils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e5614b-7568-4897-8479-685c22228590]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a189dc81-cbc3-4868-9b44-20f794a4afc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d3cc53-ee86-4dbf-9775-959614def2a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02cde6b-66b7-4ab3-bb83-1d2d0c84550c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:16:07 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:16:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1707f8-7a0b-4f13-a553-1b0473f687fe]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG os_brick.utils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:07 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Updating existing volume attachment record: 49b24976-442c-4cb6-8e78-b5764ac05976 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-f0c5c634-46bf-47f0-8abe-72a98816a0e9 req-85a29f5d-af70-4285-8e8c-ad80110c66e6 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received event network-vif-deleted-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:08 user nova-compute[76815]: INFO nova.compute.manager [req-f0c5c634-46bf-47f0-8abe-72a98816a0e9 req-85a29f5d-af70-4285-8e8c-ad80110c66e6 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Neutron deleted interface 4bdab381-62b2-40ae-8cd6-beab79fb7d70; detaching it from the instance and deleting it from the info cache
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.network.neutron [req-f0c5c634-46bf-47f0-8abe-72a98816a0e9 req-85a29f5d-af70-4285-8e8c-ad80110c66e6 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-f0c5c634-46bf-47f0-8abe-72a98816a0e9 req-85a29f5d-af70-4285-8e8c-ad80110c66e6 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Detach interface failed, port_id=4bdab381-62b2-40ae-8cd6-beab79fb7d70, reason: Instance 800a8573-b384-4919-8871-d5dbda9da3bd could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:16:08 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Took 0.92 seconds to deallocate network for instance.
Nov 14 22:16:08 user nova-compute[76815]: WARNING nova.volume.cinder [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Attachment 65935b55-a4f1-4b20-b195-7aab0f8f8f59 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 65935b55-a4f1-4b20-b195-7aab0f8f8f59. (HTTP 404) (Request-ID: req-652f2676-2ea1-44da-b658-6f9943451222)
Nov 14 22:16:08 user nova-compute[76815]: INFO nova.compute.manager [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 22:16:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.network.neutron [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Successfully created port: 13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-82c5e1e1-844e-4bac-875e-a23a0f212686 req-4503b88c-92cf-4003-9caa-a14e489508d4 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received event network-vif-plugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-82c5e1e1-844e-4bac-875e-a23a0f212686 req-4503b88c-92cf-4003-9caa-a14e489508d4 service nova] Acquiring lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-82c5e1e1-844e-4bac-875e-a23a0f212686 req-4503b88c-92cf-4003-9caa-a14e489508d4 service nova] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-82c5e1e1-844e-4bac-875e-a23a0f212686 req-4503b88c-92cf-4003-9caa-a14e489508d4 service nova] Lock "800a8573-b384-4919-8871-d5dbda9da3bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-82c5e1e1-844e-4bac-875e-a23a0f212686 req-4503b88c-92cf-4003-9caa-a14e489508d4 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] No waiting events found dispatching network-vif-plugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:08 user nova-compute[76815]: WARNING nova.compute.manager [req-82c5e1e1-844e-4bac-875e-a23a0f212686 req-4503b88c-92cf-4003-9caa-a14e489508d4 service nova] [instance: 800a8573-b384-4919-8871-d5dbda9da3bd] Received unexpected event network-vif-plugged-4bdab381-62b2-40ae-8cd6-beab79fb7d70 for instance with vm_state deleted and task_state None.
Nov 14 22:16:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:08 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Deleted allocations for instance 800a8573-b384-4919-8871-d5dbda9da3bd
Nov 14 22:16:08 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Snapshot image upload complete
Nov 14 22:16:08 user nova-compute[76815]: INFO nova.compute.manager [None req-dc15ca28-69b6-487d-9f43-feadff09c89d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Took 5.62 seconds to snapshot the instance on the hypervisor.
Nov 14 22:16:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3a007b82-87e6-4813-a306-d20864c6406d tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "800a8573-b384-4919-8871-d5dbda9da3bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.891s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.network.neutron [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Successfully updated port: 13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "refresh_cache-59178f91-5932-41b5-9e21-7c2401be86ac" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquired lock "refresh_cache-59178f91-5932-41b5-9e21-7c2401be86ac" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:16:08 user nova-compute[76815]: DEBUG nova.network.neutron [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:16:09 user nova-compute[76815]: DEBUG nova.network.neutron [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:16:09 user nova-compute[76815]: DEBUG nova.network.neutron [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Updating instance_info_cache with network_info: [{"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Releasing lock "refresh_cache-59178f91-5932-41b5-9e21-7c2401be86ac" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:16:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Instance network_info: |[{"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:16:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba3cfb3b-e38b-480c-9312-8d93fed83f4a req-f5f85e92-23c9-470f-b2ca-dab820385892 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-changed-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba3cfb3b-e38b-480c-9312-8d93fed83f4a req-f5f85e92-23c9-470f-b2ca-dab820385892 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Refreshing instance network info cache due to event network-changed-13aded5c-717f-4931-8072-8e000de745b8. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:16:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba3cfb3b-e38b-480c-9312-8d93fed83f4a req-f5f85e92-23c9-470f-b2ca-dab820385892 service nova] Acquiring lock "refresh_cache-59178f91-5932-41b5-9e21-7c2401be86ac" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:16:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba3cfb3b-e38b-480c-9312-8d93fed83f4a req-f5f85e92-23c9-470f-b2ca-dab820385892 service nova] Acquired lock "refresh_cache-59178f91-5932-41b5-9e21-7c2401be86ac" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:16:10 user nova-compute[76815]: DEBUG nova.network.neutron [req-ba3cfb3b-e38b-480c-9312-8d93fed83f4a req-f5f85e92-23c9-470f-b2ca-dab820385892 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Refreshing network info cache for port 13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG nova.network.neutron [req-ba3cfb3b-e38b-480c-9312-8d93fed83f4a req-f5f85e92-23c9-470f-b2ca-dab820385892 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Updated VIF entry in instance network info cache for port 13aded5c-717f-4931-8072-8e000de745b8. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG nova.network.neutron [req-ba3cfb3b-e38b-480c-9312-8d93fed83f4a req-f5f85e92-23c9-470f-b2ca-dab820385892 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Updating instance_info_cache with network_info: [{"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba3cfb3b-e38b-480c-9312-8d93fed83f4a req-f5f85e92-23c9-470f-b2ca-dab820385892 service nova] Releasing lock "refresh_cache-59178f91-5932-41b5-9e21-7c2401be86ac" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:16:11 user nova-compute[76815]: INFO nova.compute.claims [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Claim successful on node user
Nov 14 22:16:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:16:11 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:16:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:16:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG nova.policy [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a7d3c7ad83543cbafc5e5ebcc2e7a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202f1749bf684dbfa082a1bf1eee2b2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:16:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Creating image(s)
Nov 14 22:16:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "/opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "/opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "/opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "200fc229fb75755e21d37500b69af652a700421b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "200fc229fb75755e21d37500b69af652a700421b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Successfully created port: 3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b.part --force-share --output=json" returned: 0 in 0.235s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.images [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] 404a69b9-c2ea-4f17-ad90-1b680b09fd0c was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b.part /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:16:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Creating image(s)
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Ensure instance console log exists: /opt/stack/data/nova/instances/59178f91-5932-41b5-9e21-7c2401be86ac/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Start _get_guest_xml network_info=[{"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQnjmcxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59178f91-5932-41b5-9e21-7c2401be86ac', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8687df9-9d10-453e-b043-566948973a21', 'serial': 'e8687df9-9d10-453e-b043-566948973a21'}, 'attachment_id': '49b24976-442c-4cb6-8e78-b5764ac05976', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:16:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:16:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b.part /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b.converted" returned: 0 in 0.262s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQnjmcxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:13 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:13 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:13 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea80e4b-785d-426e-925d-2e796bbd6e65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:16:13 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa8e3bc-e194-4141-97ec-0c295bdd03dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21] added
Nov 14 22:16:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[231d3c54-947e-4a33-b049-5baa8116293f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: INFO nova.compute.manager [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Terminating instance
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b04c2aa-23a8-4b09-8f7c-4f69ef52d0ba]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQnjmcxD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQnjmcxD" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e191f42-39f3-4cbe-8536-464cae88baac]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQnjmcxD'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "200fc229fb75755e21d37500b69af652a700421b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.628s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1372b7cb-e11d-4b33-986f-c3f81fbf9a18]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecf08d9-7552-4d55-b358-78c60f562aa8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Successfully updated port: 3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquired lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-c3c317de-8db6-48a0-ad31-9d63e69a5f49 req-6f1fc5fa-4321-4f84-a1ff-e145af735dee service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received event network-changed-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-c3c317de-8db6-48a0-ad31-9d63e69a5f49 req-6f1fc5fa-4321-4f84-a1ff-e145af735dee service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Refreshing instance network info cache due to event network-changed-3801d538-e087-498b-8bee-5759b04d9117. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c3c317de-8db6-48a0-ad31-9d63e69a5f49 req-6f1fc5fa-4321-4f84-a1ff-e145af735dee service nova] Acquiring lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[061f9950-a593-43fb-bb5c-3d39c2594d0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21, portal: 172.16.0.220,3260]
Nov 14 22:16:14 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21, portal: 172.16.0.220,3260] successful.
Nov 14 22:16:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40967149-1ceb-43c3-9aae-7deb009fb0f1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b --force-share --output=json" returned: 0 in 0.213s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df663f37-9d3c-43ce-bfe0-719644358deb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "200fc229fb75755e21d37500b69af652a700421b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "200fc229fb75755e21d37500b69af652a700421b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:14 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d0bbb-8132-4c8b-9c9c-9a8c05e40c77]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQnjmcxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-f0870b8c-b7c0-40f8-bc70-fa75e7ac78ea req-8d9621e8-8c7b-4b57-8c5f-98dc88bb62ae service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f0870b8c-b7c0-40f8-bc70-fa75e7ac78ea req-8d9621e8-8c7b-4b57-8c5f-98dc88bb62ae service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f0870b8c-b7c0-40f8-bc70-fa75e7ac78ea req-8d9621e8-8c7b-4b57-8c5f-98dc88bb62ae service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f0870b8c-b7c0-40f8-bc70-fa75e7ac78ea req-8d9621e8-8c7b-4b57-8c5f-98dc88bb62ae service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-f0870b8c-b7c0-40f8-bc70-fa75e7ac78ea req-8d9621e8-8c7b-4b57-8c5f-98dc88bb62ae service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-f0870b8c-b7c0-40f8-bc70-fa75e7ac78ea req-8d9621e8-8c7b-4b57-8c5f-98dc88bb62ae service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-unplugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b --force-share --output=json" returned: 0 in 0.230s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b,backing_fmt=raw /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b,backing_fmt=raw /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk 1073741824" returned: 0 in 0.067s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "200fc229fb75755e21d37500b69af652a700421b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Updating instance_info_cache with network_info: [{"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Releasing lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Instance network_info: |[{"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c3c317de-8db6-48a0-ad31-9d63e69a5f49 req-6f1fc5fa-4321-4f84-a1ff-e145af735dee service nova] Acquired lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.neutron [req-c3c317de-8db6-48a0-ad31-9d63e69a5f49 req-6f1fc5fa-4321-4f84-a1ff-e145af735dee service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Refreshing network info cache for port 3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Ensure instance console log exists: /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Start _get_guest_xml network_info=[{"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1f5824cb3afdeb7d98f2848ee8e2e1b0',container_format='bare',created_at=2023-11-14T22:16:03Z,direct_url=<?>,disk_format='qcow2',id=404a69b9-c2ea-4f17-ad90-1b680b09fd0c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1849655174',owner='202f1749bf684dbfa082a1bf1eee2b2e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T22:16:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '404a69b9-c2ea-4f17-ad90-1b680b09fd0c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:16:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1f5824cb3afdeb7d98f2848ee8e2e1b0',container_format='bare',created_at=2023-11-14T22:16:03Z,direct_url=<?>,disk_format='qcow2',id=404a69b9-c2ea-4f17-ad90-1b680b09fd0c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1849655174',owner='202f1749bf684dbfa082a1bf1eee2b2e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T22:16:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1619379568',display_name='tempest-TestStampPattern-server-1619379568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1619379568',id=26,image_ref='404a69b9-c2ea-4f17-ad90-1b680b09fd0c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIz7adDgP7X73sp1hk5zQagIy7YAy0++VDgbZ8Zj9KPV4CgTwfipeuF7/mA4SwM5VVflsdyyENIt6u4cntTENc7drNh/bLAHBUCOpidpzrADFvxpLgpN2YTtL81gY4jTQ==',key_name='tempest-TestStampPattern-197761174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='202f1749bf684dbfa082a1bf1eee2b2e',ramdisk_id='',reservation_id='r-x9ye0tse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0dc9077f-493b-44b7-bfde-1d448ae001fd',image_min_disk='1',image_min_ram='0',image_owner_id='202f1749bf684dbfa082a1bf1eee2b2e',image_owner_project_name='tempest-TestStampPattern-1059321344',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1059321344-project-member',image_user_id='6a7d3c7ad83543cbafc5e5ebcc2e7a01',network_allocated='True',owner_project_name='tempest-TestStampPattern-1059321344',owner_user_name='tempest-TestStampPattern-1059321344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:16:12Z,user_data=None,user_id='6a7d3c7ad83543cbafc5e5ebcc2e7a01',uuid=01f81d12-add4-448c-a257-42a90c9e833d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converting VIF {"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:49,bridge_name='br-int',has_traffic_filtering=True,id=3801d538-e087-498b-8bee-5759b04d9117,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3801d538-e0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.objects.instance [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'pci_devices' on Instance uuid 01f81d12-add4-448c-a257-42a90c9e833d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:16:14 user nova-compute[76815]:   <uuid>01f81d12-add4-448c-a257-42a90c9e833d</uuid>
Nov 14 22:16:14 user nova-compute[76815]:   <name>instance-0000001a</name>
Nov 14 22:16:14 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:16:14 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:16:14 user nova-compute[76815]:   <metadata>
Nov 14 22:16:14 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:16:14 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:16:14 user nova-compute[76815]:       <nova:name>tempest-TestStampPattern-server-1619379568</nova:name>
Nov 14 22:16:14 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:16:14</nova:creationTime>
Nov 14 22:16:14 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:16:14 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:16:14 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:16:14 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:16:14 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:16:14 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:16:14 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:16:14 user nova-compute[76815]:       <nova:owner>
Nov 14 22:16:14 user nova-compute[76815]:         <nova:user uuid="6a7d3c7ad83543cbafc5e5ebcc2e7a01">tempest-TestStampPattern-1059321344-project-member</nova:user>
Nov 14 22:16:14 user nova-compute[76815]:         <nova:project uuid="202f1749bf684dbfa082a1bf1eee2b2e">tempest-TestStampPattern-1059321344</nova:project>
Nov 14 22:16:14 user nova-compute[76815]:       </nova:owner>
Nov 14 22:16:14 user nova-compute[76815]:       <nova:root type="image" uuid="404a69b9-c2ea-4f17-ad90-1b680b09fd0c"/>
Nov 14 22:16:14 user nova-compute[76815]:       <nova:ports>
Nov 14 22:16:14 user nova-compute[76815]:         <nova:port uuid="3801d538-e087-498b-8bee-5759b04d9117">
Nov 14 22:16:14 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 22:16:14 user nova-compute[76815]:         </nova:port>
Nov 14 22:16:14 user nova-compute[76815]:       </nova:ports>
Nov 14 22:16:14 user nova-compute[76815]:     </nova:instance>
Nov 14 22:16:14 user nova-compute[76815]:   </metadata>
Nov 14 22:16:14 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:16:14 user nova-compute[76815]:     <system>
Nov 14 22:16:14 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:16:14 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:16:14 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:16:14 user nova-compute[76815]:       <entry name="serial">01f81d12-add4-448c-a257-42a90c9e833d</entry>
Nov 14 22:16:14 user nova-compute[76815]:       <entry name="uuid">01f81d12-add4-448c-a257-42a90c9e833d</entry>
Nov 14 22:16:14 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:16:14 user nova-compute[76815]:     </system>
Nov 14 22:16:14 user nova-compute[76815]:   </sysinfo>
Nov 14 22:16:14 user nova-compute[76815]:   <os>
Nov 14 22:16:14 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:16:14 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:16:14 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:16:14 user nova-compute[76815]:   </os>
Nov 14 22:16:14 user nova-compute[76815]:   <features>
Nov 14 22:16:14 user nova-compute[76815]:     <acpi/>
Nov 14 22:16:14 user nova-compute[76815]:     <apic/>
Nov 14 22:16:14 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:16:14 user nova-compute[76815]:   </features>
Nov 14 22:16:14 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:16:14 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:16:14 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:16:14 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:16:14 user nova-compute[76815]:   </clock>
Nov 14 22:16:14 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:16:14 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:16:14 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:16:14 user nova-compute[76815]:   </cpu>
Nov 14 22:16:14 user nova-compute[76815]:   <devices>
Nov 14 22:16:14 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:16:14 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:16:14 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk"/>
Nov 14 22:16:14 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:16:14 user nova-compute[76815]:     </disk>
Nov 14 22:16:14 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:16:14 user nova-compute[76815]:       <mac address="fa:16:3e:d0:31:49"/>
Nov 14 22:16:14 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:16:14 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:16:14 user nova-compute[76815]:       <target dev="tap3801d538-e0"/>
Nov 14 22:16:14 user nova-compute[76815]:     </interface>
Nov 14 22:16:14 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:16:14 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/console.log" append="off"/>
Nov 14 22:16:14 user nova-compute[76815]:     </serial>
Nov 14 22:16:14 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:16:14 user nova-compute[76815]:     <video>
Nov 14 22:16:14 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:16:14 user nova-compute[76815]:     </video>
Nov 14 22:16:14 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:16:14 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:16:14 user nova-compute[76815]:     </rng>
Nov 14 22:16:14 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:16:14 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:16:14 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:16:14 user nova-compute[76815]:     </memballoon>
Nov 14 22:16:14 user nova-compute[76815]:   </devices>
Nov 14 22:16:14 user nova-compute[76815]: </domain>
Nov 14 22:16:14 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1619379568',display_name='tempest-TestStampPattern-server-1619379568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1619379568',id=26,image_ref='404a69b9-c2ea-4f17-ad90-1b680b09fd0c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIz7adDgP7X73sp1hk5zQagIy7YAy0++VDgbZ8Zj9KPV4CgTwfipeuF7/mA4SwM5VVflsdyyENIt6u4cntTENc7drNh/bLAHBUCOpidpzrADFvxpLgpN2YTtL81gY4jTQ==',key_name='tempest-TestStampPattern-197761174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='202f1749bf684dbfa082a1bf1eee2b2e',ramdisk_id='',reservation_id='r-x9ye0tse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0dc9077f-493b-44b7-bfde-1d448ae001fd',image_min_disk='1',image_min_ram='0',image_owner_id='202f1749bf684dbfa082a1bf1eee2b2e',image_owner_project_name='tempest-TestStampPattern-1059321344',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1059321344-project-member',image_user_id='6a7d3c7ad83543cbafc5e5ebcc2e7a01',network_allocated='True',owner_project_name='tempest-TestStampPattern-1059321344',owner_user_name='tempest-TestStampPattern-1059321344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:16:12Z,user_data=None,user_id='6a7d3c7ad83543cbafc5e5ebcc2e7a01',uuid=01f81d12-add4-448c-a257-42a90c9e833d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converting VIF {"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:49,bridge_name='br-int',has_traffic_filtering=True,id=3801d538-e087-498b-8bee-5759b04d9117,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3801d538-e0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_vif [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:49,bridge_name='br-int',has_traffic_filtering=True,id=3801d538-e087-498b-8bee-5759b04d9117,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3801d538-e0') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:16:14 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Instance destroyed successfully.
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6abff377-e3fb-5894-ae8f-87f273329095', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.objects.instance [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lazy-loading 'resources' on Instance uuid 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-740046946',display_name='tempest-ServerActionsTestOtherB-server-740046946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-740046946',id=2,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfyvibJFZ3+P9cPClSwRvADUm92jfJ8o6BTO5uqmymmHB851px3NqgPd2QQeHEC+IldkPYJsk/5QKXvtU1Q/t5lYj1GQkm68rGyQFBVBYEDC0MsPp+SZUuhpQDRtsF5Yw==',key_name='tempest-keypair-689678311',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:13:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3021ff6fd9ad4958a9907c1b75f89a56',ramdisk_id='',reservation_id='r-uw1mr160',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-614422799',owner_user_name='tempest-ServerActionsTestOtherB-614422799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82120460b2945879455016ed97cafe9',uuid=2a7d6b8f-698f-4e0b-a28e-131121d8fe8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converting VIF {"id": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "address": "fa:16:3e:33:73:f8", "network": {"id": "aa2393d6-6607-4395-b3e4-5a57dd7000b7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1630974441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3021ff6fd9ad4958a9907c1b75f89a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b0d4dc-1d", "ovs_interfaceid": "01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_vif [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b0d4dc-1d, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3801d538-e0, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3801d538-e0, col_values=(('qos', UUID('24573e2a-8212-40f7-8aa1-c7494387bd59')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3801d538-e0, col_values=(('external_ids', {'iface-id': '3801d538-e087-498b-8bee-5759b04d9117', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:31:49', 'vm-uuid': '01f81d12-add4-448c-a257-42a90c9e833d'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: INFO os_vif [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:49,bridge_name='br-int',has_traffic_filtering=True,id=3801d538-e087-498b-8bee-5759b04d9117,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3801d538-e0')
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=271e39ea-29ef-4130-9fa0-d94c0d9eae15) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:14 user nova-compute[76815]: INFO os_vif [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:73:f8,bridge_name='br-int',has_traffic_filtering=True,id=01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae,network=Network(aa2393d6-6607-4395-b3e4-5a57dd7000b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b0d4dc-1d')
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doZtJFaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:14 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:16:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:16:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No VIF found with MAC fa:16:3e:d0:31:49, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23362303565306338', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362303565306338', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.424s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[56964d8a-93de-436a-9411-d06008a960bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:16:15 user nova-compute[76815]: No targets found.
Nov 14 22:16:15 user nova-compute[76815]: iSNS:
Nov 14 22:16:15 user nova-compute[76815]: No targets found.
Nov 14 22:16:15 user nova-compute[76815]: STATIC:
Nov 14 22:16:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:16:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:16:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:16:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29
Nov 14 22:16:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f
Nov 14 22:16:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:15 user nova-compute[76815]: FIRMWARE:
Nov 14 22:16:15 user nova-compute[76815]: No targets found.
Nov 14 22:16:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:16:15 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:16:15 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1451091158',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1451091158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1451091158',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBfuOBp83xFoozD4dLOfo8dQ40taUPwJ2s0+hzOwisN11fg8QrfdP9UFvZHdNYzzP7RNm0hvHlYFImCsCDyJfsapGaAzIne3pM1+Dd+cHkZESgJwjCK7M7vYMow6EM2aA==',key_name='tempest-keypair-1731125153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-mu4kpiua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:16:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=59178f91-5932-41b5-9e21-7c2401be86ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c4:3a,bridge_name='br-int',has_traffic_filtering=True,id=13aded5c-717f-4931-8072-8e000de745b8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13aded5c-71') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.objects.instance [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'pci_devices' on Instance uuid 59178f91-5932-41b5-9e21-7c2401be86ac {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:16:15 user nova-compute[76815]:   <uuid>59178f91-5932-41b5-9e21-7c2401be86ac</uuid>
Nov 14 22:16:15 user nova-compute[76815]:   <name>instance-00000019</name>
Nov 14 22:16:15 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:16:15 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:16:15 user nova-compute[76815]:   <metadata>
Nov 14 22:16:15 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:16:15 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:16:15 user nova-compute[76815]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1451091158</nova:name>
Nov 14 22:16:15 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:16:13</nova:creationTime>
Nov 14 22:16:15 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:16:15 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:16:15 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:16:15 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:16:15 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:16:15 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:16:15 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:16:15 user nova-compute[76815]:       <nova:owner>
Nov 14 22:16:15 user nova-compute[76815]:         <nova:user uuid="0fd5c7c940b0429994db55b93cb421ed">tempest-TestVolumeBootPattern-1821264948-project-member</nova:user>
Nov 14 22:16:15 user nova-compute[76815]:         <nova:project uuid="673708a9f12541f6929c86eb60ca83c8">tempest-TestVolumeBootPattern-1821264948</nova:project>
Nov 14 22:16:15 user nova-compute[76815]:       </nova:owner>
Nov 14 22:16:15 user nova-compute[76815]:       <nova:ports>
Nov 14 22:16:15 user nova-compute[76815]:         <nova:port uuid="13aded5c-717f-4931-8072-8e000de745b8">
Nov 14 22:16:15 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 22:16:15 user nova-compute[76815]:         </nova:port>
Nov 14 22:16:15 user nova-compute[76815]:       </nova:ports>
Nov 14 22:16:15 user nova-compute[76815]:     </nova:instance>
Nov 14 22:16:15 user nova-compute[76815]:   </metadata>
Nov 14 22:16:15 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:16:15 user nova-compute[76815]:     <system>
Nov 14 22:16:15 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:16:15 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:16:15 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:16:15 user nova-compute[76815]:       <entry name="serial">59178f91-5932-41b5-9e21-7c2401be86ac</entry>
Nov 14 22:16:15 user nova-compute[76815]:       <entry name="uuid">59178f91-5932-41b5-9e21-7c2401be86ac</entry>
Nov 14 22:16:15 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:16:15 user nova-compute[76815]:     </system>
Nov 14 22:16:15 user nova-compute[76815]:   </sysinfo>
Nov 14 22:16:15 user nova-compute[76815]:   <os>
Nov 14 22:16:15 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:16:15 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:16:15 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:16:15 user nova-compute[76815]:   </os>
Nov 14 22:16:15 user nova-compute[76815]:   <features>
Nov 14 22:16:15 user nova-compute[76815]:     <acpi/>
Nov 14 22:16:15 user nova-compute[76815]:     <apic/>
Nov 14 22:16:15 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:16:15 user nova-compute[76815]:   </features>
Nov 14 22:16:15 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:16:15 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:16:15 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:16:15 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:16:15 user nova-compute[76815]:   </clock>
Nov 14 22:16:15 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:16:15 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:16:15 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:16:15 user nova-compute[76815]:   </cpu>
Nov 14 22:16:15 user nova-compute[76815]:   <devices>
Nov 14 22:16:15 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:16:15 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:16:15 user nova-compute[76815]:       <source dev="/dev/sdb"/>
Nov 14 22:16:15 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:16:15 user nova-compute[76815]:       <serial>e8687df9-9d10-453e-b043-566948973a21</serial>
Nov 14 22:16:15 user nova-compute[76815]:     </disk>
Nov 14 22:16:15 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:16:15 user nova-compute[76815]:       <mac address="fa:16:3e:d6:c4:3a"/>
Nov 14 22:16:15 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:16:15 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:16:15 user nova-compute[76815]:       <target dev="tap13aded5c-71"/>
Nov 14 22:16:15 user nova-compute[76815]:     </interface>
Nov 14 22:16:15 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:16:15 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/59178f91-5932-41b5-9e21-7c2401be86ac/console.log" append="off"/>
Nov 14 22:16:15 user nova-compute[76815]:     </serial>
Nov 14 22:16:15 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:16:15 user nova-compute[76815]:     <video>
Nov 14 22:16:15 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:16:15 user nova-compute[76815]:     </video>
Nov 14 22:16:15 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:16:15 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:16:15 user nova-compute[76815]:     </rng>
Nov 14 22:16:15 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:16:15 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:16:15 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:16:15 user nova-compute[76815]:     </memballoon>
Nov 14 22:16:15 user nova-compute[76815]:   </devices>
Nov 14 22:16:15 user nova-compute[76815]: </domain>
Nov 14 22:16:15 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1451091158',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1451091158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1451091158',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBfuOBp83xFoozD4dLOfo8dQ40taUPwJ2s0+hzOwisN11fg8QrfdP9UFvZHdNYzzP7RNm0hvHlYFImCsCDyJfsapGaAzIne3pM1+Dd+cHkZESgJwjCK7M7vYMow6EM2aA==',key_name='tempest-keypair-1731125153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-mu4kpiua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:16:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=59178f91-5932-41b5-9e21-7c2401be86ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c4:3a,bridge_name='br-int',has_traffic_filtering=True,id=13aded5c-717f-4931-8072-8e000de745b8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13aded5c-71') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_vif [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c4:3a,bridge_name='br-int',has_traffic_filtering=True,id=13aded5c-717f-4931-8072-8e000de745b8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13aded5c-71') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8c2302e-563d-5528-8ac9-fefa51653389', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da70b27-ee4b-4b41-9418-0402990cb53f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13aded5c-71, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13aded5c-71, col_values=(('qos', UUID('3a634e59-b1fe-4098-be0b-0ef7c7d0015a')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13aded5c-71, col_values=(('external_ids', {'iface-id': '13aded5c-717f-4931-8072-8e000de745b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:c4:3a', 'vm-uuid': '59178f91-5932-41b5-9e21-7c2401be86ac'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4397a28b-8b9c-4d2d-90e6-470bbea5b548]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:15 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:15 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:15 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:15 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f (non-flash)
Nov 14 22:16:15 user nova-compute[76815]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:15 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:15 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:15 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4507be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:15 user nova-compute[76815]: INFO os_vif [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c4:3a,bridge_name='br-int',has_traffic_filtering=True,id=13aded5c-717f-4931-8072-8e000de745b8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13aded5c-71')
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dc652b-9f0d-4091-894f-4fdb3ae2b051]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-c3c317de-8db6-48a0-ad31-9d63e69a5f49 req-6f1fc5fa-4321-4f84-a1ff-e145af735dee service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Updated VIF entry in instance network info cache for port 3801d538-e087-498b-8bee-5759b04d9117. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-c3c317de-8db6-48a0-ad31-9d63e69a5f49 req-6f1fc5fa-4321-4f84-a1ff-e145af735dee service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Updating instance_info_cache with network_info: [{"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1f123e-87e2-4238-944d-480b30aa41a2]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c3c317de-8db6-48a0-ad31-9d63e69a5f49 req-6f1fc5fa-4321-4f84-a1ff-e145af735dee service nova] Releasing lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No VIF found with MAC fa:16:3e:d6:c4:3a, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[624876dc-66a6-492e-9bd8-91f410174a36]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d43a892-361b-4a33-96ae-7d9aff87c479]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c12f20b-ab9d-462e-a736-bf540e2969a1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[096642d8-97e1-4da4-9055-0cbdd5b62254]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260]
Nov 14 22:16:15 user nova-compute[76815]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f, portal: 172.16.0.220,3260] successful.
Nov 14 22:16:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925a86c5-4658-4b61-9360-7b14b96cfe4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff9b61-5c39-4fb0-8341-ff79dd053583]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] <== disconnect_volume: return (732ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:16:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Deleting instance files /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a_del
Nov 14 22:16:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Deletion of /opt/stack/data/nova/instances/2a7d6b8f-698f-4e0b-a28e-131121d8fe8a_del complete
Nov 14 22:16:15 user nova-compute[76815]: INFO nova.compute.manager [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Took 1.72 seconds to destroy the instance on the hypervisor.
Nov 14 22:16:15 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:16:15 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:16:16 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-3ffa64af-a1ae-4f73-8f7f-a3901bef2676 req-d28ac13f-9c88-445e-889a-38f3a135634d service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3ffa64af-a1ae-4f73-8f7f-a3901bef2676 req-d28ac13f-9c88-445e-889a-38f3a135634d service nova] Acquiring lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3ffa64af-a1ae-4f73-8f7f-a3901bef2676 req-d28ac13f-9c88-445e-889a-38f3a135634d service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3ffa64af-a1ae-4f73-8f7f-a3901bef2676 req-d28ac13f-9c88-445e-889a-38f3a135634d service nova] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-3ffa64af-a1ae-4f73-8f7f-a3901bef2676 req-d28ac13f-9c88-445e-889a-38f3a135634d service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] No waiting events found dispatching network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:16 user nova-compute[76815]: WARNING nova.compute.manager [req-3ffa64af-a1ae-4f73-8f7f-a3901bef2676 req-d28ac13f-9c88-445e-889a-38f3a135634d service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received unexpected event network-vif-plugged-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae for instance with vm_state active and task_state deleting.
Nov 14 22:16:16 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Took 0.79 seconds to deallocate network for instance.
Nov 14 22:16:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-76549f6e-1b25-4ea0-904a-c983af1ed927 req-7df77864-a597-44c6-8ac0-1bc1a1065700 service nova] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Received event network-vif-deleted-01b0d4dc-1da6-4dc5-bbe0-a38d11e41eae {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:17 user nova-compute[76815]: INFO nova.compute.manager [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] [instance: 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 22:16:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:16:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:17 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Deleted allocations for instance 2a7d6b8f-698f-4e0b-a28e-131121d8fe8a
Nov 14 22:16:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5e798f2d-d456-4d82-b7b9-d492203d588d tempest-ServerActionsTestOtherB-614422799 tempest-ServerActionsTestOtherB-614422799-project-member] Lock "2a7d6b8f-698f-4e0b-a28e-131121d8fe8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.913s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received event network-vif-plugged-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] No waiting events found dispatching network-vif-plugged-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:18 user nova-compute[76815]: WARNING nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received unexpected event network-vif-plugged-3801d538-e087-498b-8bee-5759b04d9117 for instance with vm_state building and task_state spawning.
Nov 14 22:16:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received event network-vif-plugged-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] No waiting events found dispatching network-vif-plugged-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:18 user nova-compute[76815]: WARNING nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received unexpected event network-vif-plugged-3801d538-e087-498b-8bee-5759b04d9117 for instance with vm_state building and task_state spawning.
Nov 14 22:16:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] No waiting events found dispatching network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:18 user nova-compute[76815]: WARNING nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received unexpected event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 for instance with vm_state building and task_state spawning.
Nov 14 22:16:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] No waiting events found dispatching network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:18 user nova-compute[76815]: WARNING nova.compute.manager [req-6ccc4518-177d-4648-a7b0-27815e46ccd1 req-930cd04a-9857-44ad-93a1-2b2a7662fee2 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received unexpected event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 for instance with vm_state building and task_state spawning.
Nov 14 22:16:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "bb235db0-61d3-4e29-9794-b7c181f074d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:19 user nova-compute[76815]: INFO nova.compute.manager [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Terminating instance
Nov 14 22:16:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:16:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Instance spawned successfully.
Nov 14 22:16:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Instance spawned successfully.
Nov 14 22:16:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Took 7.74 seconds to spawn the instance on the hypervisor.
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Instance destroyed successfully.
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.objects.instance [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lazy-loading 'resources' on Instance uuid bb235db0-61d3-4e29-9794-b7c181f074d2 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.compute.manager [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Took 8.81 seconds to build instance.
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-601697772',display_name='tempest-ServersNegativeTestJSON-server-601697772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-601697772',id=1,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bde13b6fb9174200aecd89b17c2b675e',ramdisk_id='',reservation_id='r-wcvfdz4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1003137324',owner_user_name='tempest-ServersNegativeTestJSON-1003137324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:07:51Z,user_data=None,user_id='494ca9737a354c719f4b286053f7a1b4',uuid=bb235db0-61d3-4e29-9794-b7c181f074d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converting VIF {"id": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "address": "fa:16:3e:c4:82:23", "network": {"id": "cce9ad66-74b0-4732-8107-47a3fa060231", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1015220492-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bde13b6fb9174200aecd89b17c2b675e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0a86c8-5a", "ovs_interfaceid": "0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:82:23,bridge_name='br-int',has_traffic_filtering=True,id=0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0a86c8-5a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_vif [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:82:23,bridge_name='br-int',has_traffic_filtering=True,id=0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0a86c8-5a') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c0a86c8-5a, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee3b8a54-2929-4c24-bd96-df991050de6d) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8a39456-ebf6-4769-9e1d-f33d9fdad8f6 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.909s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:20 user nova-compute[76815]: INFO os_vif [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:82:23,bridge_name='br-int',has_traffic_filtering=True,id=0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9,network=Network(cce9ad66-74b0-4732-8107-47a3fa060231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0a86c8-5a')
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Deleting instance files /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2_del
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Deletion of /opt/stack/data/nova/instances/bb235db0-61d3-4e29-9794-b7c181f074d2_del complete
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.compute.manager [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Took 13.36 seconds to build instance.
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-00af694b-1d8a-44e3-a99f-e8abf11269c4 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "59178f91-5932-41b5-9e21-7c2401be86ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.466s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.compute.manager [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received event network-vif-unplugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] Acquiring lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] No waiting events found dispatching network-vif-unplugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received event network-vif-unplugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received event network-vif-plugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] Acquiring lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] No waiting events found dispatching network-vif-plugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:20 user nova-compute[76815]: WARNING nova.compute.manager [req-1677e5e9-bdc0-44ab-b96f-0abd2b7166f4 req-ea28774d-8aa8-4183-b13e-7a2378856d0e service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received unexpected event network-vif-plugged-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 for instance with vm_state active and task_state deleting.
Nov 14 22:16:20 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance df6f5090-eb0a-49b6-8e6c-e46475f7c784 is timed out.
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Successfully detached device vdb from instance df6f5090-eb0a-49b6-8e6c-e46475f7c784 from the live domain config.
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bnEXcRFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:20 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[952fba34-bb7b-4d70-a32c-860e184a8f56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:16:20 user nova-compute[76815]: No targets found.
Nov 14 22:16:20 user nova-compute[76815]: iSNS:
Nov 14 22:16:20 user nova-compute[76815]: No targets found.
Nov 14 22:16:20 user nova-compute[76815]: STATIC:
Nov 14 22:16:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:16:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:16:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:16:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:20 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29
Nov 14 22:16:20 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:20 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:20 user nova-compute[76815]: FIRMWARE:
Nov 14 22:16:20 user nova-compute[76815]: No targets found.
Nov 14 22:16:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:16:20 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:16:20 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:20 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Took 0.45 seconds to deallocate network for instance.
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63491c7-b6be-4b87-91fd-d42e69dafdb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbc8732-b95b-43c7-a614-e456ad58c903]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:20 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:20 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:20 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:20 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:20 user nova-compute[76815]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 (non-flash)
Nov 14 22:16:20 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a477d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29'): ({'sdf'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Removing single pathed devices sdf {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7b24f0-d6d5-403c-9ad9-872945a4f7b9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b86059-1571-40f5-aae1-8110a761638f]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Flushing IO for device /dev/sdf {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[177473de-c88e-445d-abb8-488816ec1466]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e46366-a18a-4505-8ba5-75a0ba6e44df]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3932d5a-8aa6-4e5f-a513-8c84c3282890]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21a0223-a96f-4f0c-b2ba-f97ba1aac4a2]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29, portal: 172.16.0.220,3260]
Nov 14 22:16:20 user nova-compute[76815]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29, portal: 172.16.0.220,3260] successful.
Nov 14 22:16:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:285228a8-2ddc-4f64-9eb4-27326cd0bd29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf32eb42-bec7-4a77-b28f-14188b4fd58c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] <== disconnect_volume: return (325ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:21 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Deleted allocations for instance bb235db0-61d3-4e29-9794-b7c181f074d2
Nov 14 22:16:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-86468196-7123-4ace-b02e-22ea292ca393 tempest-ServersNegativeTestJSON-1003137324 tempest-ServersNegativeTestJSON-1003137324-project-member] Lock "bb235db0-61d3-4e29-9794-b7c181f074d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.821s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG nova.objects.instance [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lazy-loading 'flavor' on Instance uuid df6f5090-eb0a-49b6-8e6c-e46475f7c784 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c2a9d0eb-c735-4e41-b4de-ae4e62af5f72 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.636s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-c2c2d4f0-47af-48f4-b5a9-aecef2472cfc req-a245252f-1a1c-4206-b3bd-3b7132b31815 service nova] [instance: bb235db0-61d3-4e29-9794-b7c181f074d2] Received event network-vif-deleted-0c0a86c8-5a82-4d47-98c1-ff4a1fe02fc9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-50193a26-43c1-4871-b402-fc7048c853fe req-e7d96cfd-5b34-4f47-9856-caacf2d4f041 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-changed-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-50193a26-43c1-4871-b402-fc7048c853fe req-e7d96cfd-5b34-4f47-9856-caacf2d4f041 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Refreshing instance network info cache due to event network-changed-0ce994cd-fb33-42e5-80c7-0878f2e9890a. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:16:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50193a26-43c1-4871-b402-fc7048c853fe req-e7d96cfd-5b34-4f47-9856-caacf2d4f041 service nova] Acquiring lock "refresh_cache-bc3a520b-21e4-463e-a39d-a397c3e6b811" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:16:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50193a26-43c1-4871-b402-fc7048c853fe req-e7d96cfd-5b34-4f47-9856-caacf2d4f041 service nova] Acquired lock "refresh_cache-bc3a520b-21e4-463e-a39d-a397c3e6b811" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:16:25 user nova-compute[76815]: DEBUG nova.network.neutron [req-50193a26-43c1-4871-b402-fc7048c853fe req-e7d96cfd-5b34-4f47-9856-caacf2d4f041 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Refreshing network info cache for port 0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:16:25 user nova-compute[76815]: DEBUG nova.network.neutron [req-50193a26-43c1-4871-b402-fc7048c853fe req-e7d96cfd-5b34-4f47-9856-caacf2d4f041 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Updated VIF entry in instance network info cache for port 0ce994cd-fb33-42e5-80c7-0878f2e9890a. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:16:25 user nova-compute[76815]: DEBUG nova.network.neutron [req-50193a26-43c1-4871-b402-fc7048c853fe req-e7d96cfd-5b34-4f47-9856-caacf2d4f041 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Updating instance_info_cache with network_info: [{"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-50193a26-43c1-4871-b402-fc7048c853fe req-e7d96cfd-5b34-4f47-9856-caacf2d4f041 service nova] Releasing lock "refresh_cache-bc3a520b-21e4-463e-a39d-a397c3e6b811" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG nova.objects.instance [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'flavor' on Instance uuid bc3a520b-21e4-463e-a39d-a397c3e6b811 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:26 user nova-compute[76815]: INFO nova.compute.manager [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Attaching volume 3b133282-cd5a-41df-9370-0c0b0c4951aa to /dev/vdb
Nov 14 22:16:26 user nova-compute[76815]: DEBUG os_brick.utils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[338a417c-507a-4d62-8a6f-6d8d9e139ef7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81d836c-2b77-46f8-b017-dac2d3d5e281]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70dfb29-5a9e-4c1d-8b66-e20affd79513]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0864e7b-8813-4b65-838b-f85f624c9bb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:16:26 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:16:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[22453a29-08c6-48f5-b3d2-b6ff3c30c087]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG os_brick.utils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Updating existing volume attachment record: f618ad4d-abce-49d3-8280-acd6e66d567e {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:16:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:16:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnGOJNPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:30 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:16:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:30 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:16:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:30 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:16:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[34570bc4-b00a-4229-ae3e-bf6d0abb2f9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:16:30 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44ac89e-6619-4bfb-9478-88fc951c70fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa] added
Nov 14 22:16:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[435598d7-58a1-468b-aa77-eb1ae522a1e6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a4e3b1-1ed7-46ea-9197-98b619332853]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnGOJNPV {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnGOJNPV" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f7de4a-96cc-43a4-8190-02f61be48276]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnGOJNPV'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02e5591-93c7-48a5-aea5-5d966e39e2ec]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96444e6-49bd-4c64-aee0-6741e3516202]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2922bd5-e247-4e90-9165-ae76a181c2d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260]
Nov 14 22:16:31 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260] successful.
Nov 14 22:16:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6be1905-fb66-4564-ae28-3e7bf54ffb38]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed94eb6-9b17-4623-9b79-e1e962142132]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:16:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:31 user nova-compute[76815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:16:31 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[937c7bcb-80e2-4cd3-b927-058ee68f760c]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:16:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnGOJNPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23161643361646631', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161643361646631', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG nova.objects.instance [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'flavor' on Instance uuid bc3a520b-21e4-463e-a39d-a397c3e6b811 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:16:32 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:16:32 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:16:32 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:16:32 user nova-compute[76815]:   <serial>3b133282-cd5a-41df-9370-0c0b0c4951aa</serial>
Nov 14 22:16:32 user nova-compute[76815]: </disk>
Nov 14 22:16:32 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:16:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No VIF found with MAC fa:16:3e:ec:14:23, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:16:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:16:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9ab756db-c2fe-4cc9-ac2b-d0924b0979bc tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.742s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:34 user nova-compute[76815]: INFO nova.compute.manager [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Rebuilding instance
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.353s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-fb85b7ee-caf7-42a0-9ca8-94366c840c6b req-b66c9613-91e1-4f07-8508-43956f7f2eed service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-unplugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fb85b7ee-caf7-42a0-9ca8-94366c840c6b req-b66c9613-91e1-4f07-8508-43956f7f2eed service nova] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fb85b7ee-caf7-42a0-9ca8-94366c840c6b req-b66c9613-91e1-4f07-8508-43956f7f2eed service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fb85b7ee-caf7-42a0-9ca8-94366c840c6b req-b66c9613-91e1-4f07-8508-43956f7f2eed service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-fb85b7ee-caf7-42a0-9ca8-94366c840c6b req-b66c9613-91e1-4f07-8508-43956f7f2eed service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] No waiting events found dispatching network-vif-unplugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:35 user nova-compute[76815]: WARNING nova.compute.manager [req-fb85b7ee-caf7-42a0-9ca8-94366c840c6b req-b66c9613-91e1-4f07-8508-43956f7f2eed service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received unexpected event network-vif-unplugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a for instance with vm_state active and task_state rebuilding.
Nov 14 22:16:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:35 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance destroyed successfully.
Nov 14 22:16:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: INFO nova.compute.manager [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Detaching volume 3b133282-cd5a-41df-9370-0c0b0c4951aa
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: INFO nova.virt.block_device [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Attempting to driver detach volume 3b133282-cd5a-41df-9370-0c0b0c4951aa from mountpoint /dev/vdb
Nov 14 22:16:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Attempting to detach device vdb from instance bc3a520b-21e4-463e-a39d-a397c3e6b811 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:16:36 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:16:36 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:16:36 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:16:36 user nova-compute[76815]:   <serial>3b133282-cd5a-41df-9370-0c0b0c4951aa</serial>
Nov 14 22:16:36 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:16:36 user nova-compute[76815]: </disk>
Nov 14 22:16:36 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:16:36 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully detached device vdb from instance bc3a520b-21e4-463e-a39d-a397c3e6b811 from the persistent domain config.
Nov 14 22:16:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnGOJNPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:36 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deaf6f4-b976-40c5-a93f-cb8d6714de50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:16:36 user nova-compute[76815]: No targets found.
Nov 14 22:16:36 user nova-compute[76815]: iSNS:
Nov 14 22:16:36 user nova-compute[76815]: No targets found.
Nov 14 22:16:36 user nova-compute[76815]: STATIC:
Nov 14 22:16:36 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:16:36 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:36 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:36 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa
Nov 14 22:16:36 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:36 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:36 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:16:36 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:36 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:36 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:16:36 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:36 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:36 user nova-compute[76815]: FIRMWARE:
Nov 14 22:16:36 user nova-compute[76815]: No targets found.
Nov 14 22:16:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:16:36 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:16:36 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[45749930-68bd-4ba2-a9d6-0d86a28ed6a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b420fcdf-db7e-4211-9942-99f493baab12]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:36 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:36 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:36 user nova-compute[76815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:16:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:36 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:36 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:36 user nova-compute[76815]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:16:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a477e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6521fb-7907-4fd6-b013-f7363889ad53]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6132ee1-06c2-4a9b-8ade-2ac140df0ed4]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[220fd4bc-d4ee-4e00-a7d7-f825abb78a8b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebce16a-2790-4766-a818-bae9fc95fa6d]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[41775b2c-d313-465b-a6cd-a07d29500678]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59acd206-c8e0-4d98-b53d-5e54040119b4]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260]
Nov 14 22:16:36 user nova-compute[76815]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260] successful.
Nov 14 22:16:36 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a57eb02-b333-4b68-b90a-8e00cba1b7be]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== disconnect_volume: return (318ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:16:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:37 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:16:37 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7712MB free_disk=25.215167999267578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0dc9077f-493b-44b7-bfde-1d448ae001fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance df6f5090-eb0a-49b6-8e6c-e46475f7c784 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bc3a520b-21e4-463e-a39d-a397c3e6b811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 648e61c3-1925-4e22-8dc7-3bd8c0558487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 59178f91-5932-41b5-9e21-7c2401be86ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 01f81d12-add4-448c-a257-42a90c9e833d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:16:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance destroyed successfully.
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-154093738',display_name='tempest-ServerActionsTestOtherA-server-1563321332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-154093738',id=22,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnVf2EWXLMs2o+nLDUXPoKm0hgmUOTA1zAb/3U4CPDjSB7YxhNV5mJeWkrA2EmLxBCKN0nz61aoShmbeUlFgdVdFbCYX1l1oQTWzXwjLMEqD/lfWCuGPtA9s6dLyaaG9A==',key_name='tempest-keypair-1456019355',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:14:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-7f3rq2il',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=bc3a520b-21e4-463e-a39d-a397c3e6b811,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_vif [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ce994cd-fb, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65597c82-dcec-4115-9167-b91887c496ac) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:37 user nova-compute[76815]: INFO os_vif [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb')
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnGOJNPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:37 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b20c568-1fcb-4627-a99e-9225ac1d4bac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:16:37 user nova-compute[76815]: No targets found.
Nov 14 22:16:37 user nova-compute[76815]: iSNS:
Nov 14 22:16:37 user nova-compute[76815]: No targets found.
Nov 14 22:16:37 user nova-compute[76815]: STATIC:
Nov 14 22:16:37 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:16:37 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:37 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:37 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:16:37 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:37 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:37 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:16:37 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:16:37 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:16:37 user nova-compute[76815]: FIRMWARE:
Nov 14 22:16:37 user nova-compute[76815]: No targets found.
Nov 14 22:16:37 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:16:37 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:16:37 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a5274a-074f-489b-a58a-b08f67583d2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[914ab462-93db-4a9b-b92a-2865a1fe5fbd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-8d0401f8-fa55-4aee-a8dd-005fe225aaea req-bb13c011-a2e1-42de-8352-5c5c0448b0d4 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8d0401f8-fa55-4aee-a8dd-005fe225aaea req-bb13c011-a2e1-42de-8352-5c5c0448b0d4 service nova] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8d0401f8-fa55-4aee-a8dd-005fe225aaea req-bb13c011-a2e1-42de-8352-5c5c0448b0d4 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8d0401f8-fa55-4aee-a8dd-005fe225aaea req-bb13c011-a2e1-42de-8352-5c5c0448b0d4 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-8d0401f8-fa55-4aee-a8dd-005fe225aaea req-bb13c011-a2e1-42de-8352-5c5c0448b0d4 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] No waiting events found dispatching network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:37 user nova-compute[76815]: WARNING nova.compute.manager [req-8d0401f8-fa55-4aee-a8dd-005fe225aaea req-bb13c011-a2e1-42de-8352-5c5c0448b0d4 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received unexpected event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a for instance with vm_state active and task_state rebuilding.
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:37 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:37 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:37 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:37 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:37 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:37 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8262710>, {}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Disconnecting from: [] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== disconnect_volume: return (97ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:16:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Deleting instance files /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811_del
Nov 14 22:16:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Deletion of /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811_del complete
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:37 user nova-compute[76815]: INFO nova.virt.block_device [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Booting with volume 3b133282-cd5a-41df-9370-0c0b0c4951aa at /dev/vdb
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.utils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e35e3f-31e8-410e-beca-9271cd72d513]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea82b01-d5d7-42ce-943c-7b1363ba54cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cf5127-7704-480e-9921-d12aab8eb61e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5f36bd-cfef-4577-baad-1c7ac7d26f87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:16:37 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:16:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9c4cb9-d66e-42aa-94ad-f098c080692e]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG os_brick.utils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:37 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Updating existing volume attachment record: 521f33c7-f3d9-46f6-8eac-199a92b7da7d {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:16:38 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:16:38 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:16:38 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:16:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:16:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:16:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:16:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:16:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:16:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:16:41 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 065c90e1-2099-4446-a998-de681bedf500] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:16:41 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updating instance_info_cache with network_info: [{"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:16:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:16:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:16:42 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Creating image(s)
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk 1073741824" returned: 0 in 0.047s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Cannot resize image /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Ensure instance console log exists: /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Start _get_guest_xml network_info=[{"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnGOJNPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc3a520b-21e4-463e-a39d-a397c3e6b811', 'attached_at': '', 'detached_at': '', 'volume_id': '3b133282-cd5a-41df-9370-0c0b0c4951aa', 'serial': '3b133282-cd5a-41df-9370-0c0b0c4951aa'}, 'attachment_id': '521f33c7-f3d9-46f6-8eac-199a92b7da7d', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:16:43 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 22:16:43 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.objects.instance [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc3a520b-21e4-463e-a39d-a397c3e6b811 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnGOJNPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:16:43 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:43 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:16:43 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba7125a-4f5a-46c7-8b91-ab87794f5559]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:16:43 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[757192f3-f71e-4ff1-a88c-54faa285d4f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa] added
Nov 14 22:16:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[608a9be3-37f8-4de6-b9c3-f487f97249af]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97ebe0b-be92-4842-a101-cae556343e82]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnGOJNPV {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnGOJNPV" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea2d378-7e99-4f73-be56-8c858d73467f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnGOJNPV'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26523efb-b90c-48a0-8221-d494fc65eb34]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed63bbf5-bec0-40d9-8bf8-256dde4bcadb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc52640b-0f71-4f09-b542-8f67232bb05b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260]
Nov 14 22:16:43 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260] successful.
Nov 14 22:16:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff926b15-7252-48c1-a606-56f4dd62b27d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2baad4-c512-4ba6-9c07-0e10fe3cf0f3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:16:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:16:43 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:16:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[22141e74-cb42-4327-be61-7e6380d195e5]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:16:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnGOJNPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:16:44 user nova-compute[76815]: INFO nova.compute.claims [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Claim successful on node user
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:16:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23161643361646631', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161643361646631', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.policy [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c67499628cb4369bc042f00b6a4303b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a8307d87eb4927b49944f0a0055ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-154093738',display_name='tempest-ServerActionsTestOtherA-server-1563321332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-154093738',id=22,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnVf2EWXLMs2o+nLDUXPoKm0hgmUOTA1zAb/3U4CPDjSB7YxhNV5mJeWkrA2EmLxBCKN0nz61aoShmbeUlFgdVdFbCYX1l1oQTWzXwjLMEqD/lfWCuGPtA9s6dLyaaG9A==',key_name='tempest-keypair-1456019355',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:14:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-7f3rq2il',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=bc3a520b-21e4-463e-a39d-a397c3e6b811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:16:44 user nova-compute[76815]:   <uuid>bc3a520b-21e4-463e-a39d-a397c3e6b811</uuid>
Nov 14 22:16:44 user nova-compute[76815]:   <name>instance-00000016</name>
Nov 14 22:16:44 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:16:44 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:16:44 user nova-compute[76815]:   <metadata>
Nov 14 22:16:44 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:16:44 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:16:44 user nova-compute[76815]:       <nova:name>tempest-ServerActionsTestOtherA-server-1563321332</nova:name>
Nov 14 22:16:44 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:16:43</nova:creationTime>
Nov 14 22:16:44 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:16:44 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:16:44 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:16:44 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:16:44 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:16:44 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:16:44 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:16:44 user nova-compute[76815]:       <nova:owner>
Nov 14 22:16:44 user nova-compute[76815]:         <nova:user uuid="85a900897f3a42bd89f966f4b7e253f6">tempest-ServerActionsTestOtherA-2016206168-project-member</nova:user>
Nov 14 22:16:44 user nova-compute[76815]:         <nova:project uuid="60b7e88b0ec54c5b9f15ae859e8c3984">tempest-ServerActionsTestOtherA-2016206168</nova:project>
Nov 14 22:16:44 user nova-compute[76815]:       </nova:owner>
Nov 14 22:16:44 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:16:44 user nova-compute[76815]:       <nova:ports>
Nov 14 22:16:44 user nova-compute[76815]:         <nova:port uuid="0ce994cd-fb33-42e5-80c7-0878f2e9890a">
Nov 14 22:16:44 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:16:44 user nova-compute[76815]:         </nova:port>
Nov 14 22:16:44 user nova-compute[76815]:       </nova:ports>
Nov 14 22:16:44 user nova-compute[76815]:     </nova:instance>
Nov 14 22:16:44 user nova-compute[76815]:   </metadata>
Nov 14 22:16:44 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:16:44 user nova-compute[76815]:     <system>
Nov 14 22:16:44 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:16:44 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:16:44 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:16:44 user nova-compute[76815]:       <entry name="serial">bc3a520b-21e4-463e-a39d-a397c3e6b811</entry>
Nov 14 22:16:44 user nova-compute[76815]:       <entry name="uuid">bc3a520b-21e4-463e-a39d-a397c3e6b811</entry>
Nov 14 22:16:44 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:16:44 user nova-compute[76815]:     </system>
Nov 14 22:16:44 user nova-compute[76815]:   </sysinfo>
Nov 14 22:16:44 user nova-compute[76815]:   <os>
Nov 14 22:16:44 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:16:44 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:16:44 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:16:44 user nova-compute[76815]:   </os>
Nov 14 22:16:44 user nova-compute[76815]:   <features>
Nov 14 22:16:44 user nova-compute[76815]:     <acpi/>
Nov 14 22:16:44 user nova-compute[76815]:     <apic/>
Nov 14 22:16:44 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:16:44 user nova-compute[76815]:   </features>
Nov 14 22:16:44 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:16:44 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:16:44 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:16:44 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:16:44 user nova-compute[76815]:   </clock>
Nov 14 22:16:44 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:16:44 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:16:44 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:16:44 user nova-compute[76815]:   </cpu>
Nov 14 22:16:44 user nova-compute[76815]:   <devices>
Nov 14 22:16:44 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:16:44 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:16:44 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk"/>
Nov 14 22:16:44 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:16:44 user nova-compute[76815]:     </disk>
Nov 14 22:16:44 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:16:44 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:16:44 user nova-compute[76815]:       <source dev="/dev/sdc"/>
Nov 14 22:16:44 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:16:44 user nova-compute[76815]:       <serial>3b133282-cd5a-41df-9370-0c0b0c4951aa</serial>
Nov 14 22:16:44 user nova-compute[76815]:     </disk>
Nov 14 22:16:44 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:16:44 user nova-compute[76815]:       <mac address="fa:16:3e:ec:14:23"/>
Nov 14 22:16:44 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:16:44 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:16:44 user nova-compute[76815]:       <target dev="tap0ce994cd-fb"/>
Nov 14 22:16:44 user nova-compute[76815]:     </interface>
Nov 14 22:16:44 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:16:44 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/console.log" append="off"/>
Nov 14 22:16:44 user nova-compute[76815]:     </serial>
Nov 14 22:16:44 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:16:44 user nova-compute[76815]:     <video>
Nov 14 22:16:44 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:16:44 user nova-compute[76815]:     </video>
Nov 14 22:16:44 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:16:44 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:16:44 user nova-compute[76815]:     </rng>
Nov 14 22:16:44 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:16:44 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:16:44 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:16:44 user nova-compute[76815]:     </memballoon>
Nov 14 22:16:44 user nova-compute[76815]:   </devices>
Nov 14 22:16:44 user nova-compute[76815]: </domain>
Nov 14 22:16:44 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-154093738',display_name='tempest-ServerActionsTestOtherA-server-1563321332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-154093738',id=22,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnVf2EWXLMs2o+nLDUXPoKm0hgmUOTA1zAb/3U4CPDjSB7YxhNV5mJeWkrA2EmLxBCKN0nz61aoShmbeUlFgdVdFbCYX1l1oQTWzXwjLMEqD/lfWCuGPtA9s6dLyaaG9A==',key_name='tempest-keypair-1456019355',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:14:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-7f3rq2il',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=bc3a520b-21e4-463e-a39d-a397c3e6b811,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG os_vif [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e04db8c6-2a71-54b3-a9b0-de0d202cbaa4', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ce994cd-fb, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ce994cd-fb, col_values=(('qos', UUID('5ad85862-7a3e-4ced-8bcf-fcc09f0486e1')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ce994cd-fb, col_values=(('external_ids', {'iface-id': '0ce994cd-fb33-42e5-80c7-0878f2e9890a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:14:23', 'vm-uuid': 'bc3a520b-21e4-463e-a39d-a397c3e6b811'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:44 user nova-compute[76815]: INFO os_vif [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb')
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:16:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Creating image(s)
Nov 14 22:16:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "/opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "/opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:16:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No VIF found with MAC fa:16:3e:ec:14:23, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk 1073741824" returned: 0 in 0.051s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Successfully created port: 54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Cannot resize image /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Ensure instance console log exists: /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Successfully updated port: 54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "refresh_cache-0c84b4a2-e57c-420d-a184-72e493c936ae" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquired lock "refresh_cache-0c84b4a2-e57c-420d-a184-72e493c936ae" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-f768ecfb-baed-43e4-b59e-f2c8144fa37e req-bd2e3b69-c507-4358-a68e-ee7a37a5d009 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received event network-changed-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-f768ecfb-baed-43e4-b59e-f2c8144fa37e req-bd2e3b69-c507-4358-a68e-ee7a37a5d009 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Refreshing instance network info cache due to event network-changed-54bd8c17-61f2-4d38-accb-b293d98aa056. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:16:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f768ecfb-baed-43e4-b59e-f2c8144fa37e req-bd2e3b69-c507-4358-a68e-ee7a37a5d009 service nova] Acquiring lock "refresh_cache-0c84b4a2-e57c-420d-a184-72e493c936ae" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Updating instance_info_cache with network_info: [{"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Releasing lock "refresh_cache-0c84b4a2-e57c-420d-a184-72e493c936ae" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Instance network_info: |[{"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f768ecfb-baed-43e4-b59e-f2c8144fa37e req-bd2e3b69-c507-4358-a68e-ee7a37a5d009 service nova] Acquired lock "refresh_cache-0c84b4a2-e57c-420d-a184-72e493c936ae" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-f768ecfb-baed-43e4-b59e-f2c8144fa37e req-bd2e3b69-c507-4358-a68e-ee7a37a5d009 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Refreshing network info cache for port 54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Start _get_guest_xml network_info=[{"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:16:46 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:16:46 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1422902193',display_name='tempest-VolumesSnapshotTestJSON-instance-1422902193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1422902193',id=27,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsBY+7bpzCaRr2caZXw/CNIok/PGr3+eWjBEFf+0/T2qZH/FZTbVd47gODSoDqLficdMlztGI95fxnNWWfgOBGo7X7XAZdPEb4rx4pBRiPJ/2Sz2RiwV5FuTmXnJY91Mw==',key_name='tempest-keypair-302963638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47a8307d87eb4927b49944f0a0055ef1',ramdisk_id='',reservation_id='r-figdqu2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1321856389',owner_user_name='tempest-VolumesSnapshotTestJSON-1321856389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c67499628cb4369bc042f00b6a4303b',uuid=0c84b4a2-e57c-420d-a184-72e493c936ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converting VIF {"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:70:74,bridge_name='br-int',has_traffic_filtering=True,id=54bd8c17-61f2-4d38-accb-b293d98aa056,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54bd8c17-61') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.objects.instance [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c84b4a2-e57c-420d-a184-72e493c936ae {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:16:46 user nova-compute[76815]:   <uuid>0c84b4a2-e57c-420d-a184-72e493c936ae</uuid>
Nov 14 22:16:46 user nova-compute[76815]:   <name>instance-0000001b</name>
Nov 14 22:16:46 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:16:46 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:16:46 user nova-compute[76815]:   <metadata>
Nov 14 22:16:46 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:16:46 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:16:46 user nova-compute[76815]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1422902193</nova:name>
Nov 14 22:16:46 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:16:46</nova:creationTime>
Nov 14 22:16:46 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:16:46 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:16:46 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:16:46 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:16:46 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:16:46 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:16:46 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:16:46 user nova-compute[76815]:       <nova:owner>
Nov 14 22:16:46 user nova-compute[76815]:         <nova:user uuid="3c67499628cb4369bc042f00b6a4303b">tempest-VolumesSnapshotTestJSON-1321856389-project-member</nova:user>
Nov 14 22:16:46 user nova-compute[76815]:         <nova:project uuid="47a8307d87eb4927b49944f0a0055ef1">tempest-VolumesSnapshotTestJSON-1321856389</nova:project>
Nov 14 22:16:46 user nova-compute[76815]:       </nova:owner>
Nov 14 22:16:46 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:16:46 user nova-compute[76815]:       <nova:ports>
Nov 14 22:16:46 user nova-compute[76815]:         <nova:port uuid="54bd8c17-61f2-4d38-accb-b293d98aa056">
Nov 14 22:16:46 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:16:46 user nova-compute[76815]:         </nova:port>
Nov 14 22:16:46 user nova-compute[76815]:       </nova:ports>
Nov 14 22:16:46 user nova-compute[76815]:     </nova:instance>
Nov 14 22:16:46 user nova-compute[76815]:   </metadata>
Nov 14 22:16:46 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:16:46 user nova-compute[76815]:     <system>
Nov 14 22:16:46 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:16:46 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:16:46 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:16:46 user nova-compute[76815]:       <entry name="serial">0c84b4a2-e57c-420d-a184-72e493c936ae</entry>
Nov 14 22:16:46 user nova-compute[76815]:       <entry name="uuid">0c84b4a2-e57c-420d-a184-72e493c936ae</entry>
Nov 14 22:16:46 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:16:46 user nova-compute[76815]:     </system>
Nov 14 22:16:46 user nova-compute[76815]:   </sysinfo>
Nov 14 22:16:46 user nova-compute[76815]:   <os>
Nov 14 22:16:46 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:16:46 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:16:46 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:16:46 user nova-compute[76815]:   </os>
Nov 14 22:16:46 user nova-compute[76815]:   <features>
Nov 14 22:16:46 user nova-compute[76815]:     <acpi/>
Nov 14 22:16:46 user nova-compute[76815]:     <apic/>
Nov 14 22:16:46 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:16:46 user nova-compute[76815]:   </features>
Nov 14 22:16:46 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:16:46 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:16:46 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:16:46 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:16:46 user nova-compute[76815]:   </clock>
Nov 14 22:16:46 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:16:46 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:16:46 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:16:46 user nova-compute[76815]:   </cpu>
Nov 14 22:16:46 user nova-compute[76815]:   <devices>
Nov 14 22:16:46 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:16:46 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:16:46 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk"/>
Nov 14 22:16:46 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:16:46 user nova-compute[76815]:     </disk>
Nov 14 22:16:46 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:16:46 user nova-compute[76815]:       <mac address="fa:16:3e:49:70:74"/>
Nov 14 22:16:46 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:16:46 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:16:46 user nova-compute[76815]:       <target dev="tap54bd8c17-61"/>
Nov 14 22:16:46 user nova-compute[76815]:     </interface>
Nov 14 22:16:46 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:16:46 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/console.log" append="off"/>
Nov 14 22:16:46 user nova-compute[76815]:     </serial>
Nov 14 22:16:46 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:16:46 user nova-compute[76815]:     <video>
Nov 14 22:16:46 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:16:46 user nova-compute[76815]:     </video>
Nov 14 22:16:46 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:16:46 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:16:46 user nova-compute[76815]:     </rng>
Nov 14 22:16:46 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:16:46 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:16:46 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:16:46 user nova-compute[76815]:     </memballoon>
Nov 14 22:16:46 user nova-compute[76815]:   </devices>
Nov 14 22:16:46 user nova-compute[76815]: </domain>
Nov 14 22:16:46 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1422902193',display_name='tempest-VolumesSnapshotTestJSON-instance-1422902193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1422902193',id=27,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsBY+7bpzCaRr2caZXw/CNIok/PGr3+eWjBEFf+0/T2qZH/FZTbVd47gODSoDqLficdMlztGI95fxnNWWfgOBGo7X7XAZdPEb4rx4pBRiPJ/2Sz2RiwV5FuTmXnJY91Mw==',key_name='tempest-keypair-302963638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47a8307d87eb4927b49944f0a0055ef1',ramdisk_id='',reservation_id='r-figdqu2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1321856389',owner_user_name='tempest-VolumesSnapshotTestJSON-1321856389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c67499628cb4369bc042f00b6a4303b',uuid=0c84b4a2-e57c-420d-a184-72e493c936ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converting VIF {"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:70:74,bridge_name='br-int',has_traffic_filtering=True,id=54bd8c17-61f2-4d38-accb-b293d98aa056,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54bd8c17-61') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG os_vif [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:70:74,bridge_name='br-int',has_traffic_filtering=True,id=54bd8c17-61f2-4d38-accb-b293d98aa056,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54bd8c17-61') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'daa50839-04f3-5b96-beeb-eec06eb42eb0', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54bd8c17-61, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54bd8c17-61, col_values=(('qos', UUID('7ce69c97-310e-4a54-b211-78c0f8672c1e')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54bd8c17-61, col_values=(('external_ids', {'iface-id': '54bd8c17-61f2-4d38-accb-b293d98aa056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:70:74', 'vm-uuid': '0c84b4a2-e57c-420d-a184-72e493c936ae'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: INFO os_vif [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:70:74,bridge_name='br-int',has_traffic_filtering=True,id=54bd8c17-61f2-4d38-accb-b293d98aa056,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54bd8c17-61')
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No VIF found with MAC fa:16:3e:49:70:74, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-f768ecfb-baed-43e4-b59e-f2c8144fa37e req-bd2e3b69-c507-4358-a68e-ee7a37a5d009 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Updated VIF entry in instance network info cache for port 54bd8c17-61f2-4d38-accb-b293d98aa056. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-f768ecfb-baed-43e4-b59e-f2c8144fa37e req-bd2e3b69-c507-4358-a68e-ee7a37a5d009 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Updating instance_info_cache with network_info: [{"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f768ecfb-baed-43e4-b59e-f2c8144fa37e req-bd2e3b69-c507-4358-a68e-ee7a37a5d009 service nova] Releasing lock "refresh_cache-0c84b4a2-e57c-420d-a184-72e493c936ae" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:16:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-6d9da49b-bdde-4641-8484-13590ce8ab1b req-86abe681-3b81-4831-9ec2-e4a720adc7ee service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received event network-vif-plugged-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6d9da49b-bdde-4641-8484-13590ce8ab1b req-86abe681-3b81-4831-9ec2-e4a720adc7ee service nova] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6d9da49b-bdde-4641-8484-13590ce8ab1b req-86abe681-3b81-4831-9ec2-e4a720adc7ee service nova] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6d9da49b-bdde-4641-8484-13590ce8ab1b req-86abe681-3b81-4831-9ec2-e4a720adc7ee service nova] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-6d9da49b-bdde-4641-8484-13590ce8ab1b req-86abe681-3b81-4831-9ec2-e4a720adc7ee service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] No waiting events found dispatching network-vif-plugged-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:48 user nova-compute[76815]: WARNING nova.compute.manager [req-6d9da49b-bdde-4641-8484-13590ce8ab1b req-86abe681-3b81-4831-9ec2-e4a720adc7ee service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received unexpected event network-vif-plugged-54bd8c17-61f2-4d38-accb-b293d98aa056 for instance with vm_state building and task_state spawning.
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] No waiting events found dispatching network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:48 user nova-compute[76815]: WARNING nova.compute.manager [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received unexpected event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a for instance with vm_state active and task_state rebuild_spawning.
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] No waiting events found dispatching network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:48 user nova-compute[76815]: WARNING nova.compute.manager [req-ba5c1825-303e-4d06-8552-11ee844fd035 req-808ee98a-01c3-4707-8823-32543a6514a7 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received unexpected event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a for instance with vm_state active and task_state rebuild_spawning.
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:16:48 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance spawned successfully.
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Trying to apply a migration context that does not seem to be set for this instance {{(pid=76815) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 22:16:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c319ab04-f4f8-4673-99c7-218ccd9847d2 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:16:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:16:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Instance spawned successfully.
Nov 14 22:16:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:16:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:16:50 user nova-compute[76815]: INFO nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 14 22:16:50 user nova-compute[76815]: DEBUG nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:16:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-4730aff4-dcb6-4386-8c0a-4f1f2ed20988 req-7a50febc-fe72-442e-88a0-6e9373c87ce5 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received event network-vif-plugged-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4730aff4-dcb6-4386-8c0a-4f1f2ed20988 req-7a50febc-fe72-442e-88a0-6e9373c87ce5 service nova] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4730aff4-dcb6-4386-8c0a-4f1f2ed20988 req-7a50febc-fe72-442e-88a0-6e9373c87ce5 service nova] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4730aff4-dcb6-4386-8c0a-4f1f2ed20988 req-7a50febc-fe72-442e-88a0-6e9373c87ce5 service nova] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-4730aff4-dcb6-4386-8c0a-4f1f2ed20988 req-7a50febc-fe72-442e-88a0-6e9373c87ce5 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] No waiting events found dispatching network-vif-plugged-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:50 user nova-compute[76815]: WARNING nova.compute.manager [req-4730aff4-dcb6-4386-8c0a-4f1f2ed20988 req-7a50febc-fe72-442e-88a0-6e9373c87ce5 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received unexpected event network-vif-plugged-54bd8c17-61f2-4d38-accb-b293d98aa056 for instance with vm_state building and task_state spawning.
Nov 14 22:16:50 user nova-compute[76815]: INFO nova.compute.manager [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Took 5.92 seconds to build instance.
Nov 14 22:16:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-62c015e4-0b96-4d09-9ba6-20092801be1c tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.043s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.016s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:52 user nova-compute[76815]: INFO nova.compute.manager [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Terminating instance
Nov 14 22:16:52 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-13c0100c-b89d-44d8-8faf-79e2baac299e req-3b4c1922-569d-4479-a46c-bf49ebdde65c service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received event network-vif-unplugged-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-13c0100c-b89d-44d8-8faf-79e2baac299e req-3b4c1922-569d-4479-a46c-bf49ebdde65c service nova] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-13c0100c-b89d-44d8-8faf-79e2baac299e req-3b4c1922-569d-4479-a46c-bf49ebdde65c service nova] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-13c0100c-b89d-44d8-8faf-79e2baac299e req-3b4c1922-569d-4479-a46c-bf49ebdde65c service nova] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-13c0100c-b89d-44d8-8faf-79e2baac299e req-3b4c1922-569d-4479-a46c-bf49ebdde65c service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] No waiting events found dispatching network-vif-unplugged-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-13c0100c-b89d-44d8-8faf-79e2baac299e req-3b4c1922-569d-4479-a46c-bf49ebdde65c service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received event network-vif-unplugged-7775a114-c778-45fb-b919-c1fb32485bf6 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:16:53 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Instance destroyed successfully.
Nov 14 22:16:53 user nova-compute[76815]: DEBUG nova.objects.instance [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lazy-loading 'resources' on Instance uuid df6f5090-eb0a-49b6-8e6c-e46475f7c784 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076223539',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2076223539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2076223',id=21,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3fzSuEmOgnJJKCghM0skCa4E1Dkl8/HskxpUw1NUUFq8Pf7pHgVQPeyqHPlz7g3RGblpZC3A4d5K37CCeM98M3Q7GhmMRURHCuu3B5qBDEve63m0u62imMOIf1/ITTaA==',key_name='tempest-keypair-1887405505',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:14:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66c8421bdaad4948a0bed9f8a96be15c',ramdisk_id='',reservation_id='r-i52e9050',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1622516646',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:14:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='118f7d4d7bb14c6ca51e6f5f7d23eeea',uuid=df6f5090-eb0a-49b6-8e6c-e46475f7c784,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Converting VIF {"id": "7775a114-c778-45fb-b919-c1fb32485bf6", "address": "fa:16:3e:65:4e:33", "network": {"id": "ef6ec381-69cd-4bb4-954e-2dab83b076ed", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-708989750-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66c8421bdaad4948a0bed9f8a96be15c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7775a114-c7", "ovs_interfaceid": "7775a114-c778-45fb-b919-c1fb32485bf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:4e:33,bridge_name='br-int',has_traffic_filtering=True,id=7775a114-c778-45fb-b919-c1fb32485bf6,network=Network(ef6ec381-69cd-4bb4-954e-2dab83b076ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a114-c7') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG os_vif [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:4e:33,bridge_name='br-int',has_traffic_filtering=True,id=7775a114-c778-45fb-b919-c1fb32485bf6,network=Network(ef6ec381-69cd-4bb4-954e-2dab83b076ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a114-c7') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7775a114-c7, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2daf406-f687-4903-84e4-2decf676f7c0) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:16:53 user nova-compute[76815]: INFO os_vif [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:4e:33,bridge_name='br-int',has_traffic_filtering=True,id=7775a114-c778-45fb-b919-c1fb32485bf6,network=Network(ef6ec381-69cd-4bb4-954e-2dab83b076ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7775a114-c7')
Nov 14 22:16:53 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Deleting instance files /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784_del
Nov 14 22:16:53 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Deletion of /opt/stack/data/nova/instances/df6f5090-eb0a-49b6-8e6c-e46475f7c784_del complete
Nov 14 22:16:53 user nova-compute[76815]: INFO nova.compute.manager [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 22:16:53 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:16:53 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:16:54 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:16:54 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Took 0.82 seconds to deallocate network for instance.
Nov 14 22:16:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:54 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:16:54 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:16:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:54 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Deleted allocations for instance df6f5090-eb0a-49b6-8e6c-e46475f7c784
Nov 14 22:16:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b72c7ecb-a7ff-4f47-b8c1-09d693b0e7cd tempest-TestServerVolumeAttachScenarioOldVersion-1622516646 tempest-TestServerVolumeAttachScenarioOldVersion-1622516646-project-member] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.296s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-667bb5ed-1d30-4a22-9380-a2317e8d5f8e req-1f02aa10-ff81-4818-b8a4-df1452d71d94 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received event network-vif-plugged-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-667bb5ed-1d30-4a22-9380-a2317e8d5f8e req-1f02aa10-ff81-4818-b8a4-df1452d71d94 service nova] Acquiring lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:16:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-667bb5ed-1d30-4a22-9380-a2317e8d5f8e req-1f02aa10-ff81-4818-b8a4-df1452d71d94 service nova] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:16:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-667bb5ed-1d30-4a22-9380-a2317e8d5f8e req-1f02aa10-ff81-4818-b8a4-df1452d71d94 service nova] Lock "df6f5090-eb0a-49b6-8e6c-e46475f7c784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:16:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-667bb5ed-1d30-4a22-9380-a2317e8d5f8e req-1f02aa10-ff81-4818-b8a4-df1452d71d94 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] No waiting events found dispatching network-vif-plugged-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:16:55 user nova-compute[76815]: WARNING nova.compute.manager [req-667bb5ed-1d30-4a22-9380-a2317e8d5f8e req-1f02aa10-ff81-4818-b8a4-df1452d71d94 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received unexpected event network-vif-plugged-7775a114-c778-45fb-b919-c1fb32485bf6 for instance with vm_state deleted and task_state None.
Nov 14 22:16:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-667bb5ed-1d30-4a22-9380-a2317e8d5f8e req-1f02aa10-ff81-4818-b8a4-df1452d71d94 service nova] [instance: df6f5090-eb0a-49b6-8e6c-e46475f7c784] Received event network-vif-deleted-7775a114-c778-45fb-b919-c1fb32485bf6 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:16:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:16:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:17:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:15 user nova-compute[76815]: INFO nova.compute.manager [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Rescuing
Nov 14 22:17:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:17:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquired lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:17:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:17:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:16 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updating instance_info_cache with network_info: [{"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:17:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Releasing lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:17:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-69ca2023-7f89-4485-b6ce-37db69944991 req-271e29a2-f368-41be-8b36-518db3779fc2 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-unplugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-69ca2023-7f89-4485-b6ce-37db69944991 req-271e29a2-f368-41be-8b36-518db3779fc2 service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-69ca2023-7f89-4485-b6ce-37db69944991 req-271e29a2-f368-41be-8b36-518db3779fc2 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-69ca2023-7f89-4485-b6ce-37db69944991 req-271e29a2-f368-41be-8b36-518db3779fc2 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-69ca2023-7f89-4485-b6ce-37db69944991 req-271e29a2-f368-41be-8b36-518db3779fc2 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-unplugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:17 user nova-compute[76815]: WARNING nova.compute.manager [req-69ca2023-7f89-4485-b6ce-37db69944991 req-271e29a2-f368-41be-8b36-518db3779fc2 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-unplugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state active and task_state rescuing.
Nov 14 22:17:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Instance destroyed successfully.
Nov 14 22:17:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Attempting a stable device rescue
Nov 14 22:17:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Instance directory exists: not creating {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 22:17:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Creating image(s)
Nov 14 22:17:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "/opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "/opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3.part --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG nova.virt.images [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] 13f636ab-09c9-48a4-a23f-bed290dd2087 was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3.part /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3.part /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3.converted" returned: 0 in 0.201s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.412s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3 --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3,backing_fmt=raw /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-6daa08fe-1efe-4a35-93e7-bc7ae5b4ad6a req-e955e5b3-8436-429b-b548-acd25288ca10 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6daa08fe-1efe-4a35-93e7-bc7ae5b4ad6a req-e955e5b3-8436-429b-b548-acd25288ca10 service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6daa08fe-1efe-4a35-93e7-bc7ae5b4ad6a req-e955e5b3-8436-429b-b548-acd25288ca10 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6daa08fe-1efe-4a35-93e7-bc7ae5b4ad6a req-e955e5b3-8436-429b-b548-acd25288ca10 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-6daa08fe-1efe-4a35-93e7-bc7ae5b4ad6a req-e955e5b3-8436-429b-b548-acd25288ca10 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:19 user nova-compute[76815]: WARNING nova.compute.manager [req-6daa08fe-1efe-4a35-93e7-bc7ae5b4ad6a req-e955e5b3-8436-429b-b548-acd25288ca10 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state active and task_state rescuing.
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3,backing_fmt=raw /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue" returned: 0 in 0.060s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'migration_context' on Instance uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<0ba89777-a1fe-4754-9f3b-4e7a2daaa550> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Start _get_guest_xml network_info=[{"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "vif_mac": "fa:16:3e:42:73:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '13f636ab-09c9-48a4-a23f-bed290dd2087', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMaLtgSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '0ba89777-a1fe-4754-9f3b-4e7a2daaa550', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3bfd852-1215-49c7-81ef-eea070001bbd', 'serial': 'b3bfd852-1215-49c7-81ef-eea070001bbd'}, 'attachment_id': '57839eef-0794-4b20-a65d-6f7abb857ac1', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'resources' on Instance uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<0ba89777-a1fe-4754-9f3b-4e7a2daaa550> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<0ba89777-a1fe-4754-9f3b-4e7a2daaa550> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:17:19 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:17:19 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<0ba89777-a1fe-4754-9f3b-4e7a2daaa550> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMaLtgSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:17:19 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:17:19 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:17:19 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5792a586-cc0f-4c97-b13a-7d4326ecf012]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xMaLtgSs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 22:17:19 user nova-compute[76815]: node.name = iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:17:19 user nova-compute[76815]: node.tpgt = -1
Nov 14 22:17:19 user nova-compute[76815]: node.startup = automatic
Nov 14 22:17:19 user nova-compute[76815]: node.leading_login = No
Nov 14 22:17:19 user nova-compute[76815]: iface.iscsi_ifacename = default
Nov 14 22:17:19 user nova-compute[76815]: iface.net_ifacename = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.ipaddress = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.prefix_len = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.hwaddress = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.transport_name = tcp
Nov 14 22:17:19 user nova-compute[76815]: iface.initiatorname = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.state = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.vlan_id = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.vlan_priority = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.vlan_state = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.iface_num = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.mtu = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.port = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.bootproto = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.subnet_mask = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.gateway = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.dhcp_alt_client_id = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.dhcp_dns = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.dhcp_learn_iqn = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.dhcp_vendor_id_state = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.dhcp_vendor_id = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.dhcp_slp_da = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.fragmentation = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.gratuitous_arp = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.incoming_forwarding = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.tos_state = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.tos = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.ttl = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.delayed_ack = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.tcp_nagle = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.tcp_wsf_state = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.tcp_wsf = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.tcp_timer_scale = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.tcp_timestamp = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.redirect = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.def_task_mgmt_timeout = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.header_digest = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.data_digest = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.immediate_data = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.initial_r2t = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.data_seq_inorder = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.data_pdu_inorder = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.erl = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.max_receive_data_len = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.first_burst_len = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.max_outstanding_r2t = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.max_burst_len = 0
Nov 14 22:17:19 user nova-compute[76815]: iface.chap_auth = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.bidi_chap = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.strict_login_compliance = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.discovery_auth = <empty>
Nov 14 22:17:19 user nova-compute[76815]: iface.discovery_logout = <empty>
Nov 14 22:17:19 user nova-compute[76815]: node.discovery_address = <empty>
Nov 14 22:17:19 user nova-compute[76815]: node.discovery_port = 0
Nov 14 22:17:19 user nova-compute[76815]: node.discovery_type = static
Nov 14 22:17:19 user nova-compute[76815]: node.session.initial_cmdsn = 0
Nov 14 22:17:19 user nova-compute[76815]: node.session.initial_login_retry_max = 8
Nov 14 22:17:19 user nova-compute[76815]: node.session.xmit_thread_priority = -20
Nov 14 22:17:19 user nova-compute[76815]: node.session.cmds_max = 128
Nov 14 22:17:19 user nova-compute[76815]: node.session.queue_depth = 32
Nov 14 22:17:19 user nova-compute[76815]: node.session.nr_sessions = 1
Nov 14 22:17:19 user nova-compute[76815]: node.session.auth.authmethod = CHAP
Nov 14 22:17:19 user nova-compute[76815]: node.session.auth.username = xMaLtgSs
Nov 14 22:17:19 user nova-compute[76815]: node.session.auth.password = ***
Nov 14 22:17:19 user nova-compute[76815]: node.session.auth.username_in = <empty>
Nov 14 22:17:19 user nova-compute[76815]: node.session.auth.password_in = <empty>
Nov 14 22:17:19 user nova-compute[76815]: node.session.auth.chap_algs = MD5
Nov 14 22:17:19 user nova-compute[76815]: node.session.timeo.replacement_timeout = 120
Nov 14 22:17:19 user nova-compute[76815]: node.session.err_timeo.abort_timeout = 15
Nov 14 22:17:19 user nova-compute[76815]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 22:17:19 user nova-compute[76815]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 22:17:19 user nova-compute[76815]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.FastAbort = Yes
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.InitialR2T = No
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.ImmediateData = Yes
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.MaxConnections = 1
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 22:17:19 user nova-compute[76815]: node.session.iscsi.ERL = 0
Nov 14 22:17:19 user nova-compute[76815]: node.session.scan = manual
Nov 14 22:17:19 user nova-compute[76815]: node.session.reopen_max = 0
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].address = 172.16.0.220
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].port = 3260
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].startup = manual
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].tcp.window_size = 524288
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].tcp.type_of_service = 0
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].timeo.logout_timeout = 15
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].timeo.login_timeout = 15
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].timeo.auth_timeout = 45
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].iscsi.DataDigest = None
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].iscsi.IFMarker = No
Nov 14 22:17:19 user nova-compute[76815]: node.conn[0].iscsi.OFMarker = No
Nov 14 22:17:19 user nova-compute[76815]: # END RECORD
Nov 14 22:17:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[856faded-ec3c-4c64-a799-89a28cc58ff7]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[390b9cc1-ca53-4ea8-804e-777075f1b5ab]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMaLtgSs {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMaLtgSs" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[648e4583-18b0-4f4e-b645-8b16b72ab869]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xMaLtgSs'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[443461e1-999d-41f8-a904-fb26768c84a2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[56703f09-9446-4ce2-85d7-339661ecc75a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:17:19 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:17:19 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:17:19 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:17:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:17:19 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:17:19 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:17:19 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:17:19 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] HCTL ('35', '0', '0', 0) found on session 26 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88951ad-a147-4871-8e33-ec970dd1bdd0]: (4, ('0 0 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching for a device in session 26 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMaLtgSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '26330646530386235', 'path': '/dev/sdd'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330646530386235', 'path': '/dev/sdd'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163209102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163209102',id=23,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-lgqcxfxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:15:42Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=0ba89777-a1fe-4754-9f3b-4e7a2daaa550,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "vif_mac": "fa:16:3e:42:73:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "vif_mac": "fa:16:3e:42:73:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:73:ea,bridge_name='br-int',has_traffic_filtering=True,id=865be8f9-6fe3-4bed-9d06-555efe17ed6d,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865be8f9-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.objects.base [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<0ba89777-a1fe-4754-9f3b-4e7a2daaa550> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:17:19 user nova-compute[76815]:   <uuid>0ba89777-a1fe-4754-9f3b-4e7a2daaa550</uuid>
Nov 14 22:17:19 user nova-compute[76815]:   <name>instance-00000017</name>
Nov 14 22:17:19 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:17:19 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:17:19 user nova-compute[76815]:   <metadata>
Nov 14 22:17:19 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:17:19 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:17:19 user nova-compute[76815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1163209102</nova:name>
Nov 14 22:17:19 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:17:19</nova:creationTime>
Nov 14 22:17:19 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:17:19 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:17:19 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:17:19 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:17:19 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:17:19 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:17:19 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:17:19 user nova-compute[76815]:       <nova:owner>
Nov 14 22:17:19 user nova-compute[76815]:         <nova:user uuid="a6ef0744ff3b459b9e32404ec12bbe55">tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member</nova:user>
Nov 14 22:17:19 user nova-compute[76815]:         <nova:project uuid="327b9fb17cb74bb0a56380b0d084cec3">tempest-ServerBootFromVolumeStableRescueTest-890378304</nova:project>
Nov 14 22:17:19 user nova-compute[76815]:       </nova:owner>
Nov 14 22:17:19 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:17:19 user nova-compute[76815]:       <nova:ports>
Nov 14 22:17:19 user nova-compute[76815]:         <nova:port uuid="865be8f9-6fe3-4bed-9d06-555efe17ed6d">
Nov 14 22:17:19 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 22:17:19 user nova-compute[76815]:         </nova:port>
Nov 14 22:17:19 user nova-compute[76815]:       </nova:ports>
Nov 14 22:17:19 user nova-compute[76815]:     </nova:instance>
Nov 14 22:17:19 user nova-compute[76815]:   </metadata>
Nov 14 22:17:19 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:17:19 user nova-compute[76815]:     <system>
Nov 14 22:17:19 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:17:19 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:17:19 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:17:19 user nova-compute[76815]:       <entry name="serial">0ba89777-a1fe-4754-9f3b-4e7a2daaa550</entry>
Nov 14 22:17:19 user nova-compute[76815]:       <entry name="uuid">0ba89777-a1fe-4754-9f3b-4e7a2daaa550</entry>
Nov 14 22:17:19 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:17:19 user nova-compute[76815]:     </system>
Nov 14 22:17:19 user nova-compute[76815]:   </sysinfo>
Nov 14 22:17:19 user nova-compute[76815]:   <os>
Nov 14 22:17:19 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:17:19 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:17:19 user nova-compute[76815]:   </os>
Nov 14 22:17:19 user nova-compute[76815]:   <features>
Nov 14 22:17:19 user nova-compute[76815]:     <acpi/>
Nov 14 22:17:19 user nova-compute[76815]:     <apic/>
Nov 14 22:17:19 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:17:19 user nova-compute[76815]:   </features>
Nov 14 22:17:19 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:17:19 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:17:19 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:17:19 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:17:19 user nova-compute[76815]:   </clock>
Nov 14 22:17:19 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:17:19 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:17:19 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:17:19 user nova-compute[76815]:   </cpu>
Nov 14 22:17:19 user nova-compute[76815]:   <devices>
Nov 14 22:17:19 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:17:19 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:17:19 user nova-compute[76815]:       <source dev="/dev/sdd"/>
Nov 14 22:17:19 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:17:19 user nova-compute[76815]:       <serial>b3bfd852-1215-49c7-81ef-eea070001bbd</serial>
Nov 14 22:17:19 user nova-compute[76815]:     </disk>
Nov 14 22:17:19 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:17:19 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:17:19 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue"/>
Nov 14 22:17:19 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:17:19 user nova-compute[76815]:       <boot order="1"/>
Nov 14 22:17:19 user nova-compute[76815]:     </disk>
Nov 14 22:17:19 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:17:19 user nova-compute[76815]:       <mac address="fa:16:3e:42:73:ea"/>
Nov 14 22:17:19 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:17:19 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:17:19 user nova-compute[76815]:       <target dev="tap865be8f9-6f"/>
Nov 14 22:17:19 user nova-compute[76815]:     </interface>
Nov 14 22:17:19 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:17:19 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/console.log" append="off"/>
Nov 14 22:17:19 user nova-compute[76815]:     </serial>
Nov 14 22:17:19 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:17:19 user nova-compute[76815]:     <video>
Nov 14 22:17:19 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:17:19 user nova-compute[76815]:     </video>
Nov 14 22:17:19 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:17:19 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:17:19 user nova-compute[76815]:     </rng>
Nov 14 22:17:19 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:17:19 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:17:19 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:17:19 user nova-compute[76815]:     </memballoon>
Nov 14 22:17:19 user nova-compute[76815]:   </devices>
Nov 14 22:17:19 user nova-compute[76815]: </domain>
Nov 14 22:17:19 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:17:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Instance destroyed successfully.
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:17:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No VIF found with MAC fa:16:3e:42:73:ea, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:17:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-713e0967-68c2-4c95-b5f6-21b869cc3e3c req-3eb2e168-433f-4bd5-b2c1-857f17cccb9c service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-713e0967-68c2-4c95-b5f6-21b869cc3e3c req-3eb2e168-433f-4bd5-b2c1-857f17cccb9c service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-713e0967-68c2-4c95-b5f6-21b869cc3e3c req-3eb2e168-433f-4bd5-b2c1-857f17cccb9c service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-713e0967-68c2-4c95-b5f6-21b869cc3e3c req-3eb2e168-433f-4bd5-b2c1-857f17cccb9c service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-713e0967-68c2-4c95-b5f6-21b869cc3e3c req-3eb2e168-433f-4bd5-b2c1-857f17cccb9c service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:21 user nova-compute[76815]: WARNING nova.compute.manager [req-713e0967-68c2-4c95-b5f6-21b869cc3e3c req-3eb2e168-433f-4bd5-b2c1-857f17cccb9c service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state active and task_state rescuing.
Nov 14 22:17:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:17:21 user nova-compute[76815]: INFO nova.compute.claims [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Claim successful on node user
Nov 14 22:17:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:21 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:17:22 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:17:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG nova.policy [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '528d6b8363524661ac87940d9c29c521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1bdb986de2488da17a7f44b6bd58e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:17:22 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Creating image(s)
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.198s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk 1073741824" returned: 0 in 0.070s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Successfully created port: 49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:17:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bd67f243-3864-4bd7-9894-be93d430bed9 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Cannot resize image /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Ensure instance console log exists: /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-2d3b3e5d-786d-4ee7-9d47-ab7c6d5deaff req-734e6cf8-e5dc-4b37-bcdd-82d1df07d7b9 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2d3b3e5d-786d-4ee7-9d47-ab7c6d5deaff req-734e6cf8-e5dc-4b37-bcdd-82d1df07d7b9 service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2d3b3e5d-786d-4ee7-9d47-ab7c6d5deaff req-734e6cf8-e5dc-4b37-bcdd-82d1df07d7b9 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2d3b3e5d-786d-4ee7-9d47-ab7c6d5deaff req-734e6cf8-e5dc-4b37-bcdd-82d1df07d7b9 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-2d3b3e5d-786d-4ee7-9d47-ab7c6d5deaff req-734e6cf8-e5dc-4b37-bcdd-82d1df07d7b9 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:23 user nova-compute[76815]: WARNING nova.compute.manager [req-2d3b3e5d-786d-4ee7-9d47-ab7c6d5deaff req-734e6cf8-e5dc-4b37-bcdd-82d1df07d7b9 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state rescued and task_state None.
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Successfully updated port: 49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquired lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-df3b4ba9-2594-441c-89aa-f21f75f03e75 req-e6591c7f-9b46-4c10-804c-0641d5c507fb service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-changed-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-df3b4ba9-2594-441c-89aa-f21f75f03e75 req-e6591c7f-9b46-4c10-804c-0641d5c507fb service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Refreshing instance network info cache due to event network-changed-49dbd78d-299e-4717-bf85-1a3ad0e83689. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-df3b4ba9-2594-441c-89aa-f21f75f03e75 req-e6591c7f-9b46-4c10-804c-0641d5c507fb service nova] Acquiring lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating instance_info_cache with network_info: [{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Releasing lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Instance network_info: |[{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-df3b4ba9-2594-441c-89aa-f21f75f03e75 req-e6591c7f-9b46-4c10-804c-0641d5c507fb service nova] Acquired lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.network.neutron [req-df3b4ba9-2594-441c-89aa-f21f75f03e75 req-e6591c7f-9b46-4c10-804c-0641d5c507fb service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Refreshing network info cache for port 49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Start _get_guest_xml network_info=[{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:17:23 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:17:23 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-937618737',display_name='tempest-ServerStableDeviceRescueTest-server-937618737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-937618737',id=28,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWjtV2c/oN0301FEraICGTVYdbwbdy/i7FSijB+CWm60Jph5H7nN7/o3v3XNaCNyM78hIA8LoU0m7Ji2TCjnVhzdkcmyOVBftbTg185VLlZCVEf5p00+5nZc7auPqUF2Q==',key_name='tempest-keypair-492100224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1bdb986de2488da17a7f44b6bd58e5',ramdisk_id='',reservation_id='r-2nwd1u0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2018122865',owner_user_name='tempest-ServerStableDeviceRescueTest-2018122865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='528d6b8363524661ac87940d9c29c521',uuid=9e076b98-3f30-4a9a-aa97-330c748de261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Converting VIF {"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d8:3f,bridge_name='br-int',has_traffic_filtering=True,id=49dbd78d-299e-4717-bf85-1a3ad0e83689,network=Network(69115285-947c-4b22-8c21-62c9d9c3578e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dbd78d-29') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:17:23 user nova-compute[76815]:   <uuid>9e076b98-3f30-4a9a-aa97-330c748de261</uuid>
Nov 14 22:17:23 user nova-compute[76815]:   <name>instance-0000001c</name>
Nov 14 22:17:23 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:17:23 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:17:23 user nova-compute[76815]:   <metadata>
Nov 14 22:17:23 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:17:23 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:17:23 user nova-compute[76815]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-937618737</nova:name>
Nov 14 22:17:23 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:17:23</nova:creationTime>
Nov 14 22:17:23 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:17:23 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:17:23 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:17:23 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:17:23 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:17:23 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:17:23 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:17:23 user nova-compute[76815]:       <nova:owner>
Nov 14 22:17:23 user nova-compute[76815]:         <nova:user uuid="528d6b8363524661ac87940d9c29c521">tempest-ServerStableDeviceRescueTest-2018122865-project-member</nova:user>
Nov 14 22:17:23 user nova-compute[76815]:         <nova:project uuid="be1bdb986de2488da17a7f44b6bd58e5">tempest-ServerStableDeviceRescueTest-2018122865</nova:project>
Nov 14 22:17:23 user nova-compute[76815]:       </nova:owner>
Nov 14 22:17:23 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:17:23 user nova-compute[76815]:       <nova:ports>
Nov 14 22:17:23 user nova-compute[76815]:         <nova:port uuid="49dbd78d-299e-4717-bf85-1a3ad0e83689">
Nov 14 22:17:23 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:17:23 user nova-compute[76815]:         </nova:port>
Nov 14 22:17:23 user nova-compute[76815]:       </nova:ports>
Nov 14 22:17:23 user nova-compute[76815]:     </nova:instance>
Nov 14 22:17:23 user nova-compute[76815]:   </metadata>
Nov 14 22:17:23 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:17:23 user nova-compute[76815]:     <system>
Nov 14 22:17:23 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:17:23 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:17:23 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:17:23 user nova-compute[76815]:       <entry name="serial">9e076b98-3f30-4a9a-aa97-330c748de261</entry>
Nov 14 22:17:23 user nova-compute[76815]:       <entry name="uuid">9e076b98-3f30-4a9a-aa97-330c748de261</entry>
Nov 14 22:17:23 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:17:23 user nova-compute[76815]:     </system>
Nov 14 22:17:23 user nova-compute[76815]:   </sysinfo>
Nov 14 22:17:23 user nova-compute[76815]:   <os>
Nov 14 22:17:23 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:17:23 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:17:23 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:17:23 user nova-compute[76815]:   </os>
Nov 14 22:17:23 user nova-compute[76815]:   <features>
Nov 14 22:17:23 user nova-compute[76815]:     <acpi/>
Nov 14 22:17:23 user nova-compute[76815]:     <apic/>
Nov 14 22:17:23 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:17:23 user nova-compute[76815]:   </features>
Nov 14 22:17:23 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:17:23 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:17:23 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:17:23 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:17:23 user nova-compute[76815]:   </clock>
Nov 14 22:17:23 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:17:23 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:17:23 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:17:23 user nova-compute[76815]:   </cpu>
Nov 14 22:17:23 user nova-compute[76815]:   <devices>
Nov 14 22:17:23 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:17:23 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:17:23 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk"/>
Nov 14 22:17:23 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:17:23 user nova-compute[76815]:     </disk>
Nov 14 22:17:23 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:17:23 user nova-compute[76815]:       <mac address="fa:16:3e:b6:d8:3f"/>
Nov 14 22:17:23 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:17:23 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:17:23 user nova-compute[76815]:       <target dev="tap49dbd78d-29"/>
Nov 14 22:17:23 user nova-compute[76815]:     </interface>
Nov 14 22:17:23 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:17:23 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/console.log" append="off"/>
Nov 14 22:17:23 user nova-compute[76815]:     </serial>
Nov 14 22:17:23 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:17:23 user nova-compute[76815]:     <video>
Nov 14 22:17:23 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:17:23 user nova-compute[76815]:     </video>
Nov 14 22:17:23 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:17:23 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:17:23 user nova-compute[76815]:     </rng>
Nov 14 22:17:23 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:17:23 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:17:23 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:17:23 user nova-compute[76815]:     </memballoon>
Nov 14 22:17:23 user nova-compute[76815]:   </devices>
Nov 14 22:17:23 user nova-compute[76815]: </domain>
Nov 14 22:17:23 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-937618737',display_name='tempest-ServerStableDeviceRescueTest-server-937618737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-937618737',id=28,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWjtV2c/oN0301FEraICGTVYdbwbdy/i7FSijB+CWm60Jph5H7nN7/o3v3XNaCNyM78hIA8LoU0m7Ji2TCjnVhzdkcmyOVBftbTg185VLlZCVEf5p00+5nZc7auPqUF2Q==',key_name='tempest-keypair-492100224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1bdb986de2488da17a7f44b6bd58e5',ramdisk_id='',reservation_id='r-2nwd1u0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2018122865',owner_user_name='tempest-ServerStableDeviceRescueTest-2018122865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='528d6b8363524661ac87940d9c29c521',uuid=9e076b98-3f30-4a9a-aa97-330c748de261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Converting VIF {"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d8:3f,bridge_name='br-int',has_traffic_filtering=True,id=49dbd78d-299e-4717-bf85-1a3ad0e83689,network=Network(69115285-947c-4b22-8c21-62c9d9c3578e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dbd78d-29') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG os_vif [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d8:3f,bridge_name='br-int',has_traffic_filtering=True,id=49dbd78d-299e-4717-bf85-1a3ad0e83689,network=Network(69115285-947c-4b22-8c21-62c9d9c3578e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dbd78d-29') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddd6ebd9-5825-5aa8-a1c3-1251e310592e', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49dbd78d-29, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49dbd78d-29, col_values=(('qos', UUID('caecc8d3-ecc3-4444-800d-2bd83d97d331')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49dbd78d-29, col_values=(('external_ids', {'iface-id': '49dbd78d-299e-4717-bf85-1a3ad0e83689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:d8:3f', 'vm-uuid': '9e076b98-3f30-4a9a-aa97-330c748de261'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:17:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:23 user nova-compute[76815]: INFO os_vif [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d8:3f,bridge_name='br-int',has_traffic_filtering=True,id=49dbd78d-299e-4717-bf85-1a3ad0e83689,network=Network(69115285-947c-4b22-8c21-62c9d9c3578e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dbd78d-29')
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] No VIF found with MAC fa:16:3e:b6:d8:3f, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.network.neutron [req-df3b4ba9-2594-441c-89aa-f21f75f03e75 req-e6591c7f-9b46-4c10-804c-0641d5c507fb service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updated VIF entry in instance network info cache for port 49dbd78d-299e-4717-bf85-1a3ad0e83689. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.network.neutron [req-df3b4ba9-2594-441c-89aa-f21f75f03e75 req-e6591c7f-9b46-4c10-804c-0641d5c507fb service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating instance_info_cache with network_info: [{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:17:24 user nova-compute[76815]: INFO nova.compute.claims [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Claim successful on node user
Nov 14 22:17:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-df3b4ba9-2594-441c-89aa-f21f75f03e75 req-e6591c7f-9b46-4c10-804c-0641d5c507fb service nova] Releasing lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:17:24 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:17:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:17:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG nova.policy [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50afb4444eea433ba80e4f4e84821101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bad961b0e704e2483d2de3d382a23b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:17:25 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Creating image(s)
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.249s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.232s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk 1073741824" returned: 0 in 0.075s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.209s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:17:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Successfully created port: 6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Cannot resize image /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Ensure instance console log exists: /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Successfully updated port: 6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquired lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG nova.compute.manager [req-92af8ce8-6f17-49aa-a92a-7e6d02c7ec1b req-e8aa1124-4a8b-42e1-b8df-7c6deb292727 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-changed-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG nova.compute.manager [req-92af8ce8-6f17-49aa-a92a-7e6d02c7ec1b req-e8aa1124-4a8b-42e1-b8df-7c6deb292727 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Refreshing instance network info cache due to event network-changed-6a9c880b-50a5-4606-9fe5-1e6ad5172aee. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-92af8ce8-6f17-49aa-a92a-7e6d02c7ec1b req-e8aa1124-4a8b-42e1-b8df-7c6deb292727 service nova] Acquiring lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:26 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating instance_info_cache with network_info: [{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Releasing lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance network_info: |[{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-92af8ce8-6f17-49aa-a92a-7e6d02c7ec1b req-e8aa1124-4a8b-42e1-b8df-7c6deb292727 service nova] Acquired lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.network.neutron [req-92af8ce8-6f17-49aa-a92a-7e6d02c7ec1b req-e8aa1124-4a8b-42e1-b8df-7c6deb292727 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Refreshing network info cache for port 6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Start _get_guest_xml network_info=[{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:17:27 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:17:27 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-196113391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-196113391',id=29,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbC3aWMQKKo3fu9/qMLPqaAgfQycwIfVXXScjuHVNwhIdPP2P5zysFD+owiLum7T2lUISKMNWqu3Slgqxg4DGxJvWuksE48UQeUJ9YCAbYcMSiT6OZRwFTcMeuHw+SIGQ==',key_name='tempest-keypair-24643289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-gin1akfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=85f255af-70de-47c0-bc23-e3957542b150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'pci_devices' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:17:27 user nova-compute[76815]:   <uuid>85f255af-70de-47c0-bc23-e3957542b150</uuid>
Nov 14 22:17:27 user nova-compute[76815]:   <name>instance-0000001d</name>
Nov 14 22:17:27 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:17:27 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:17:27 user nova-compute[76815]:   <metadata>
Nov 14 22:17:27 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:17:27 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:17:27 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-196113391</nova:name>
Nov 14 22:17:27 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:17:27</nova:creationTime>
Nov 14 22:17:27 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:17:27 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:17:27 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:17:27 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:17:27 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:17:27 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:17:27 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:17:27 user nova-compute[76815]:       <nova:owner>
Nov 14 22:17:27 user nova-compute[76815]:         <nova:user uuid="50afb4444eea433ba80e4f4e84821101">tempest-AttachVolumeShelveTestJSON-1125875673-project-member</nova:user>
Nov 14 22:17:27 user nova-compute[76815]:         <nova:project uuid="4bad961b0e704e2483d2de3d382a23b6">tempest-AttachVolumeShelveTestJSON-1125875673</nova:project>
Nov 14 22:17:27 user nova-compute[76815]:       </nova:owner>
Nov 14 22:17:27 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:17:27 user nova-compute[76815]:       <nova:ports>
Nov 14 22:17:27 user nova-compute[76815]:         <nova:port uuid="6a9c880b-50a5-4606-9fe5-1e6ad5172aee">
Nov 14 22:17:27 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 22:17:27 user nova-compute[76815]:         </nova:port>
Nov 14 22:17:27 user nova-compute[76815]:       </nova:ports>
Nov 14 22:17:27 user nova-compute[76815]:     </nova:instance>
Nov 14 22:17:27 user nova-compute[76815]:   </metadata>
Nov 14 22:17:27 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:17:27 user nova-compute[76815]:     <system>
Nov 14 22:17:27 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:17:27 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:17:27 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:17:27 user nova-compute[76815]:       <entry name="serial">85f255af-70de-47c0-bc23-e3957542b150</entry>
Nov 14 22:17:27 user nova-compute[76815]:       <entry name="uuid">85f255af-70de-47c0-bc23-e3957542b150</entry>
Nov 14 22:17:27 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:17:27 user nova-compute[76815]:     </system>
Nov 14 22:17:27 user nova-compute[76815]:   </sysinfo>
Nov 14 22:17:27 user nova-compute[76815]:   <os>
Nov 14 22:17:27 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:17:27 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:17:27 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:17:27 user nova-compute[76815]:   </os>
Nov 14 22:17:27 user nova-compute[76815]:   <features>
Nov 14 22:17:27 user nova-compute[76815]:     <acpi/>
Nov 14 22:17:27 user nova-compute[76815]:     <apic/>
Nov 14 22:17:27 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:17:27 user nova-compute[76815]:   </features>
Nov 14 22:17:27 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:17:27 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:17:27 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:17:27 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:17:27 user nova-compute[76815]:   </clock>
Nov 14 22:17:27 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:17:27 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:17:27 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:17:27 user nova-compute[76815]:   </cpu>
Nov 14 22:17:27 user nova-compute[76815]:   <devices>
Nov 14 22:17:27 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:17:27 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:17:27 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk"/>
Nov 14 22:17:27 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:17:27 user nova-compute[76815]:     </disk>
Nov 14 22:17:27 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:17:27 user nova-compute[76815]:       <mac address="fa:16:3e:55:43:4f"/>
Nov 14 22:17:27 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:17:27 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:17:27 user nova-compute[76815]:       <target dev="tap6a9c880b-50"/>
Nov 14 22:17:27 user nova-compute[76815]:     </interface>
Nov 14 22:17:27 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:17:27 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/console.log" append="off"/>
Nov 14 22:17:27 user nova-compute[76815]:     </serial>
Nov 14 22:17:27 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:17:27 user nova-compute[76815]:     <video>
Nov 14 22:17:27 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:17:27 user nova-compute[76815]:     </video>
Nov 14 22:17:27 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:17:27 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:17:27 user nova-compute[76815]:     </rng>
Nov 14 22:17:27 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:17:27 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:17:27 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:17:27 user nova-compute[76815]:     </memballoon>
Nov 14 22:17:27 user nova-compute[76815]:   </devices>
Nov 14 22:17:27 user nova-compute[76815]: </domain>
Nov 14 22:17:27 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-196113391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-196113391',id=29,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbC3aWMQKKo3fu9/qMLPqaAgfQycwIfVXXScjuHVNwhIdPP2P5zysFD+owiLum7T2lUISKMNWqu3Slgqxg4DGxJvWuksE48UQeUJ9YCAbYcMSiT6OZRwFTcMeuHw+SIGQ==',key_name='tempest-keypair-24643289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-gin1akfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=85f255af-70de-47c0-bc23-e3957542b150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG os_vif [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47b994bd-23f7-582e-bb5b-1a881133ff38', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a9c880b-50, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a9c880b-50, col_values=(('qos', UUID('ad6cef05-8e9d-4de5-b43a-583c0edaae9d')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a9c880b-50, col_values=(('external_ids', {'iface-id': '6a9c880b-50a5-4606-9fe5-1e6ad5172aee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:43:4f', 'vm-uuid': '85f255af-70de-47c0-bc23-e3957542b150'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:27 user nova-compute[76815]: INFO os_vif [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50')
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] No VIF found with MAC fa:16:3e:55:43:4f, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.network.neutron [req-92af8ce8-6f17-49aa-a92a-7e6d02c7ec1b req-e8aa1124-4a8b-42e1-b8df-7c6deb292727 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updated VIF entry in instance network info cache for port 6a9c880b-50a5-4606-9fe5-1e6ad5172aee. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.network.neutron [req-92af8ce8-6f17-49aa-a92a-7e6d02c7ec1b req-e8aa1124-4a8b-42e1-b8df-7c6deb292727 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating instance_info_cache with network_info: [{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-92af8ce8-6f17-49aa-a92a-7e6d02c7ec1b req-e8aa1124-4a8b-42e1-b8df-7c6deb292727 service nova] Releasing lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:17:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Instance spawned successfully.
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:27 user nova-compute[76815]: INFO nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 14 22:17:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:17:28 user nova-compute[76815]: INFO nova.compute.manager [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Took 6.54 seconds to build instance.
Nov 14 22:17:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8c13364b-46c1-4a5a-b6f2-c08081f748c3 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.655s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-bbacbabf-0d4d-454c-99e5-1ea6368febbc req-63c3e498-623e-4976-acc6-a7b7253e803f service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bbacbabf-0d4d-454c-99e5-1ea6368febbc req-63c3e498-623e-4976-acc6-a7b7253e803f service nova] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bbacbabf-0d4d-454c-99e5-1ea6368febbc req-63c3e498-623e-4976-acc6-a7b7253e803f service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bbacbabf-0d4d-454c-99e5-1ea6368febbc req-63c3e498-623e-4976-acc6-a7b7253e803f service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-bbacbabf-0d4d-454c-99e5-1ea6368febbc req-63c3e498-623e-4976-acc6-a7b7253e803f service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] No waiting events found dispatching network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:29 user nova-compute[76815]: WARNING nova.compute.manager [req-bbacbabf-0d4d-454c-99e5-1ea6368febbc req-63c3e498-623e-4976-acc6-a7b7253e803f service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received unexpected event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee for instance with vm_state building and task_state spawning.
Nov 14 22:17:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-a2663a94-0fc1-4c08-ba4f-00c8c804ead9 req-9b6d9dcb-b1d5-4149-bd89-8faaa342c3a9 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a2663a94-0fc1-4c08-ba4f-00c8c804ead9 req-9b6d9dcb-b1d5-4149-bd89-8faaa342c3a9 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a2663a94-0fc1-4c08-ba4f-00c8c804ead9 req-9b6d9dcb-b1d5-4149-bd89-8faaa342c3a9 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a2663a94-0fc1-4c08-ba4f-00c8c804ead9 req-9b6d9dcb-b1d5-4149-bd89-8faaa342c3a9 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-a2663a94-0fc1-4c08-ba4f-00c8c804ead9 req-9b6d9dcb-b1d5-4149-bd89-8faaa342c3a9 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:30 user nova-compute[76815]: WARNING nova.compute.manager [req-a2663a94-0fc1-4c08-ba4f-00c8c804ead9 req-9b6d9dcb-b1d5-4149-bd89-8faaa342c3a9 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state active and task_state None.
Nov 14 22:17:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:30 user nova-compute[76815]: INFO nova.compute.manager [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Shelve offloading
Nov 14 22:17:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:17:31 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance spawned successfully.
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:17:31 user nova-compute[76815]: INFO nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] No waiting events found dispatching network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:31 user nova-compute[76815]: WARNING nova.compute.manager [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received unexpected event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee for instance with vm_state building and task_state spawning.
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-changed-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Refreshing instance network info cache due to event network-changed-cb3956f2-83bd-4ad2-a094-05a0c983a4a2. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] Acquiring lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] Acquired lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.network.neutron [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Refreshing network info cache for port cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:17:31 user nova-compute[76815]: INFO nova.compute.manager [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Took 7.12 seconds to build instance.
Nov 14 22:17:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0bb766dc-8c85-4040-b834-4ac6f1070098 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.235s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:31 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Instance destroyed successfully.
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.network.neutron [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updated VIF entry in instance network info cache for port cb3956f2-83bd-4ad2-a094-05a0c983a4a2. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.network.neutron [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating instance_info_cache with network_info: [{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0ed07b1a-6a79-4bc3-aa4b-b62195bd01cc req-2be94f48-7367-4a13-98da-a18ce7e801b1 service nova] Releasing lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquired lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:17:31 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating instance_info_cache with network_info: [{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Releasing lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:32 user nova-compute[76815]: WARNING nova.compute.manager [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state active and task_state None.
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-unplugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] No waiting events found dispatching network-vif-unplugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:32 user nova-compute[76815]: WARNING nova.compute.manager [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received unexpected event network-vif-unplugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 for instance with vm_state active and task_state shelving.
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] No waiting events found dispatching network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:17:32 user nova-compute[76815]: WARNING nova.compute.manager [req-29f5c867-dd83-4182-b51b-b13924b5aee0 req-af58f865-5d4e-45c2-b8f9-7adf44715a68 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received unexpected event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 for instance with vm_state active and task_state shelving.
Nov 14 22:17:32 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Instance destroyed successfully.
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lazy-loading 'resources' on Instance uuid 648e61c3-1925-4e22-8dc7-3bd8c0558487 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1645877840',display_name='tempest-TestShelveInstance-server-1645877840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1645877840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGRF3tZ5vukvGSPGaBbMdr+SLUVCiZZp9isJCMdELcILWbk/VZ5BcYT6poET5qWmdB/8GE0Jrkl3uFLur8pBS+W+3d5igXmBtRLCmzA+Z0WsC9rpzTa0JYgzqcTz+654Q==',key_name='tempest-TestShelveInstance-731084026',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16d1e69321814403a08c9fe1a8b513c5',ramdisk_id='',reservation_id='r-cz2nxg7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1419119597',owner_user_name='tempest-TestShelveInstance-1419119597-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:15:50Z,user_data=None,user_id='b6735de275f141f5af89c22bc21adf95',uuid=648e61c3-1925-4e22-8dc7-3bd8c0558487,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converting VIF {"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG os_vif [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb3956f2-83, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18f3ed36-b2cb-40db-95a4-b6b89d470334) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:32 user nova-compute[76815]: INFO os_vif [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83')
Nov 14 22:17:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avQAsjSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:17:32 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:17:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24011bb1-8f0e-44f2-823d-69a9aff8c9fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:17:32 user nova-compute[76815]: No targets found.
Nov 14 22:17:32 user nova-compute[76815]: iSNS:
Nov 14 22:17:32 user nova-compute[76815]: No targets found.
Nov 14 22:17:32 user nova-compute[76815]: STATIC:
Nov 14 22:17:32 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:17:32 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:17:32 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:17:32 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa
Nov 14 22:17:32 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:17:32 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:17:32 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:17:32 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:17:32 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:17:32 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:17:32 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:17:32 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:17:32 user nova-compute[76815]: FIRMWARE:
Nov 14 22:17:32 user nova-compute[76815]: No targets found.
Nov 14 22:17:32 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:17:32 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:17:32 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b273b39a-9903-46ec-bb24-66259590ed2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ae5da2-ee0b-4de5-8653-472ca1ff31b6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:17:33 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:17:33 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:17:33 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:17:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:17:33 user nova-compute[76815]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:17:33 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:17:33 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:17:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a45b1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d'): ({'sde'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Removing single pathed devices sde {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[196711bb-af2e-4cfd-906a-2b0ebd151c4f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5563e738-ba70-4611-8022-7732c7f2cd2a]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Flushing IO for device /dev/sde {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b051db5-94f1-41f3-9a83-4d20f6fa8d40]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.074s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[700eb48f-1483-4689-a6ba-c664c2907b78]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ef1041-0552-431d-a66d-db567bff60a6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ef40ea-ef88-402d-be7f-7c4679fdd08f]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260]
Nov 14 22:17:33 user nova-compute[76815]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260] successful.
Nov 14 22:17:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[73afefef-d00f-4797-8288-1e6fe7d1bd4b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] <== disconnect_volume: return (344ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:17:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:17:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Deleting instance files /opt/stack/data/nova/instances/648e61c3-1925-4e22-8dc7-3bd8c0558487_del
Nov 14 22:17:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Deletion of /opt/stack/data/nova/instances/648e61c3-1925-4e22-8dc7-3bd8c0558487_del complete
Nov 14 22:17:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:34 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Deleted allocations for instance 648e61c3-1925-4e22-8dc7-3bd8c0558487
Nov 14 22:17:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:34 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lazy-loading 'numa_topology' on Instance uuid 648e61c3-1925-4e22-8dc7-3bd8c0558487 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:17:34 user nova-compute[76815]: DEBUG nova.objects.base [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Object Instance<648e61c3-1925-4e22-8dc7-3bd8c0558487> lazy-loaded attributes: resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:17:34 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:17:34 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:17:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f20d8ec-dce5-4158-94cd-4070e665924e tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.041s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:17:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:17:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:17:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7507MB free_disk=25.10409164428711GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0dc9077f-493b-44b7-bfde-1d448ae001fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bc3a520b-21e4-463e-a39d-a397c3e6b811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 59178f91-5932-41b5-9e21-7c2401be86ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 01f81d12-add4-448c-a257-42a90c9e833d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0c84b4a2-e57c-420d-a184-72e493c936ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 9e076b98-3f30-4a9a-aa97-330c748de261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 85f255af-70de-47c0-bc23-e3957542b150 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:17:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:17:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:17:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:17:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:17:41 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:17:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:42 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updating instance_info_cache with network_info: [{"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:17:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:17:42 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:17:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:42 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:17:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:17:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-fd4dee44-caef-44c0-ab37-eebc53f055c9 req-176f19cd-bdf1-4c65-a65f-4dbf26a3f4e5 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-changed-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:17:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-fd4dee44-caef-44c0-ab37-eebc53f055c9 req-176f19cd-bdf1-4c65-a65f-4dbf26a3f4e5 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Refreshing instance network info cache due to event network-changed-13aded5c-717f-4931-8072-8e000de745b8. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:17:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fd4dee44-caef-44c0-ab37-eebc53f055c9 req-176f19cd-bdf1-4c65-a65f-4dbf26a3f4e5 service nova] Acquiring lock "refresh_cache-59178f91-5932-41b5-9e21-7c2401be86ac" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:17:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fd4dee44-caef-44c0-ab37-eebc53f055c9 req-176f19cd-bdf1-4c65-a65f-4dbf26a3f4e5 service nova] Acquired lock "refresh_cache-59178f91-5932-41b5-9e21-7c2401be86ac" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:17:57 user nova-compute[76815]: DEBUG nova.network.neutron [req-fd4dee44-caef-44c0-ab37-eebc53f055c9 req-176f19cd-bdf1-4c65-a65f-4dbf26a3f4e5 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Refreshing network info cache for port 13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:17:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:17:58 user nova-compute[76815]: DEBUG nova.network.neutron [req-fd4dee44-caef-44c0-ab37-eebc53f055c9 req-176f19cd-bdf1-4c65-a65f-4dbf26a3f4e5 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Updated VIF entry in instance network info cache for port 13aded5c-717f-4931-8072-8e000de745b8. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:17:58 user nova-compute[76815]: DEBUG nova.network.neutron [req-fd4dee44-caef-44c0-ab37-eebc53f055c9 req-176f19cd-bdf1-4c65-a65f-4dbf26a3f4e5 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Updating instance_info_cache with network_info: [{"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:17:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fd4dee44-caef-44c0-ab37-eebc53f055c9 req-176f19cd-bdf1-4c65-a65f-4dbf26a3f4e5 service nova] Releasing lock "refresh_cache-59178f91-5932-41b5-9e21-7c2401be86ac" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:18:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-8f6f1f01-78e6-4bba-becb-661450668ec7 req-e4976bf0-31b6-40e2-9908-928b574fc859 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received event network-changed-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:18:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-8f6f1f01-78e6-4bba-becb-661450668ec7 req-e4976bf0-31b6-40e2-9908-928b574fc859 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Refreshing instance network info cache due to event network-changed-3801d538-e087-498b-8bee-5759b04d9117. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:18:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8f6f1f01-78e6-4bba-becb-661450668ec7 req-e4976bf0-31b6-40e2-9908-928b574fc859 service nova] Acquiring lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:18:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8f6f1f01-78e6-4bba-becb-661450668ec7 req-e4976bf0-31b6-40e2-9908-928b574fc859 service nova] Acquired lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:18:02 user nova-compute[76815]: DEBUG nova.network.neutron [req-8f6f1f01-78e6-4bba-becb-661450668ec7 req-e4976bf0-31b6-40e2-9908-928b574fc859 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Refreshing network info cache for port 3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:18:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG nova.network.neutron [req-8f6f1f01-78e6-4bba-becb-661450668ec7 req-e4976bf0-31b6-40e2-9908-928b574fc859 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Updated VIF entry in instance network info cache for port 3801d538-e087-498b-8bee-5759b04d9117. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG nova.network.neutron [req-8f6f1f01-78e6-4bba-becb-661450668ec7 req-e4976bf0-31b6-40e2-9908-928b574fc859 service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Updating instance_info_cache with network_info: [{"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8f6f1f01-78e6-4bba-becb-661450668ec7 req-e4976bf0-31b6-40e2-9908-928b574fc859 service nova] Releasing lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG nova.objects.instance [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'flavor' on Instance uuid 01f81d12-add4-448c-a257-42a90c9e833d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:03 user nova-compute[76815]: INFO nova.compute.manager [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Attaching volume c2cc7929-f02d-4c48-b2e7-34a32b983508 to /dev/vdb
Nov 14 22:18:03 user nova-compute[76815]: DEBUG os_brick.utils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1214c8-5f8e-4585-895b-29cf71e17379]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[06010b3d-cc90-490d-b9a6-d6f354ab75ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1aaa4e-44a0-43db-bea4-539238221efe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d216d69-7de2-4355-ac94-b9172b685466]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:18:03 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76d00bf-cbc7-46d0-ba41-55d93bab7b61]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG os_brick.utils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Updating existing volume attachment record: ee46f8cc-4c90-454c-97b0-0e8d97e01587 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:03 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:18:03 user nova-compute[76815]: INFO nova.compute.claims [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Claim successful on node user
Nov 14 22:18:04 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:18:04 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:18:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:18:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:18:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:18:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:18:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:18:04 user nova-compute[76815]: INFO nova.virt.block_device [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Booting with volume snapshot 4d2b2f43-f006-49ff-b662-ab11a2f13524 at /dev/vda
Nov 14 22:18:04 user nova-compute[76815]: DEBUG nova.policy [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd5c7c940b0429994db55b93cb421ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673708a9f12541f6929c86eb60ca83c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:18:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Successfully created port: f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Successfully updated port: f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "refresh_cache-ede2361a-e307-4f43-844c-b32b2ef6b4d7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquired lock "refresh_cache-ede2361a-e307-4f43-844c-b32b2ef6b4d7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-29080452-5646-41b6-a344-6a9325022d66 req-b17997c8-11da-410e-8bd8-e462ab7eb83b service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received event network-changed-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-29080452-5646-41b6-a344-6a9325022d66 req-b17997c8-11da-410e-8bd8-e462ab7eb83b service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Refreshing instance network info cache due to event network-changed-f303ac60-d3ea-41ed-a423-7de3f10c886f. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29080452-5646-41b6-a344-6a9325022d66 req-b17997c8-11da-410e-8bd8-e462ab7eb83b service nova] Acquiring lock "refresh_cache-ede2361a-e307-4f43-844c-b32b2ef6b4d7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.network.neutron [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Updating instance_info_cache with network_info: [{"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Releasing lock "refresh_cache-ede2361a-e307-4f43-844c-b32b2ef6b4d7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Instance network_info: |[{"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29080452-5646-41b6-a344-6a9325022d66 req-b17997c8-11da-410e-8bd8-e462ab7eb83b service nova] Acquired lock "refresh_cache-ede2361a-e307-4f43-844c-b32b2ef6b4d7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-29080452-5646-41b6-a344-6a9325022d66 req-b17997c8-11da-410e-8bd8-e462ab7eb83b service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Refreshing network info cache for port f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-29080452-5646-41b6-a344-6a9325022d66 req-b17997c8-11da-410e-8bd8-e462ab7eb83b service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Updated VIF entry in instance network info cache for port f303ac60-d3ea-41ed-a423-7de3f10c886f. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-29080452-5646-41b6-a344-6a9325022d66 req-b17997c8-11da-410e-8bd8-e462ab7eb83b service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Updating instance_info_cache with network_info: [{"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-29080452-5646-41b6-a344-6a9325022d66 req-b17997c8-11da-410e-8bd8-e462ab7eb83b service nova] Releasing lock "refresh_cache-ede2361a-e307-4f43-844c-b32b2ef6b4d7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:18:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOstuiUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:18:08 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:18:08 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:18:08 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[380e87a5-ba71-455f-83a7-0592b2377431]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:18:08 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea2cb7f-22a3-429e-8665-1b343bc0de5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508] added
Nov 14 22:18:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[553340b7-17f5-472c-834f-74cf5862b588]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[069bcc25-e66e-4056-9d18-e8805483cd48]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOstuiUJ {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOstuiUJ" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed04b38-5d3e-404a-bd8d-03105b5da3ad]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IOstuiUJ'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbcdd12-446a-415a-b653-52d95228c8b4]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e593836a-df0d-47f2-920c-fdc2a9cc1a89]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2abb78-4d0f-44e7-a63a-7a9f1b92663e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508, portal: 172.16.0.220,3260]
Nov 14 22:18:08 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508, portal: 172.16.0.220,3260] successful.
Nov 14 22:18:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[498c4501-6336-4bb5-ad3c-93fb7e1bedf9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6328b46-7821-4304-b8dc-0ce14d96568f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)
Nov 14 22:18:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:08 user nova-compute[76815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)
Nov 14 22:18:08 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1b0b51-f9c5-4aaa-8e15-5d0b56abd1e0]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:18:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOstuiUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:18:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:18:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23330626431643239', 'path': '/dev/sde'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:18:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330626431643239', 'path': '/dev/sde'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:18:09 user nova-compute[76815]: DEBUG nova.objects.instance [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'flavor' on Instance uuid 01f81d12-add4-448c-a257-42a90c9e833d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:18:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:18:09 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:18:09 user nova-compute[76815]:   <source dev="/dev/sde"/>
Nov 14 22:18:09 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:18:09 user nova-compute[76815]:   <serial>c2cc7929-f02d-4c48-b2e7-34a32b983508</serial>
Nov 14 22:18:09 user nova-compute[76815]: </disk>
Nov 14 22:18:09 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:18:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:18:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:18:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] No VIF found with MAC fa:16:3e:d0:31:49, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-af6cfb21-1205-4c11-87ab-87a64fa0bf0d tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.597s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG os_brick.utils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e09167-bb71-44e0-9e45-e9d934f9c9bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04e5289-fecc-424a-a7d6-68a3a76ccca3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[31847537-f43b-457e-8286-1326fbe543d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bec40a-bd99-4f38-91fa-429d0b77f89e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:18:10 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:18:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e039de2-8ec5-476d-9a79-058476d55a6d]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG os_brick.utils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:18:10 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Updating existing volume attachment record: 67fee8c0-7382-4e28-a6ec-6dfa3225d067 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:18:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:12 user nova-compute[76815]: INFO nova.compute.manager [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Detaching volume c2cc7929-f02d-4c48-b2e7-34a32b983508
Nov 14 22:18:12 user nova-compute[76815]: INFO nova.virt.block_device [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Attempting to driver detach volume c2cc7929-f02d-4c48-b2e7-34a32b983508 from mountpoint /dev/vdb
Nov 14 22:18:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Attempting to detach device vdb from instance 01f81d12-add4-448c-a257-42a90c9e833d from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:18:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:18:12 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:18:12 user nova-compute[76815]:   <source dev="/dev/sde"/>
Nov 14 22:18:12 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:18:12 user nova-compute[76815]:   <serial>c2cc7929-f02d-4c48-b2e7-34a32b983508</serial>
Nov 14 22:18:12 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:18:12 user nova-compute[76815]: </disk>
Nov 14 22:18:12 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:18:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Successfully detached device vdb from instance 01f81d12-add4-448c-a257-42a90c9e833d from the persistent domain config.
Nov 14 22:18:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01f81d12-add4-448c-a257-42a90c9e833d from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:18:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:18:12 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:18:12 user nova-compute[76815]:   <source dev="/dev/sde"/>
Nov 14 22:18:12 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:18:12 user nova-compute[76815]:   <serial>c2cc7929-f02d-4c48-b2e7-34a32b983508</serial>
Nov 14 22:18:12 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:18:12 user nova-compute[76815]: </disk>
Nov 14 22:18:12 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:18:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01f81d12-add4-448c-a257-42a90c9e833d {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:18:14 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Creating image(s)
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Ensure instance console log exists: /opt/stack/data/nova/instances/ede2361a-e307-4f43-844c-b32b2ef6b4d7/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Start _get_guest_xml network_info=[{"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T22:18:00Z,direct_url=<?>,disk_format='qcow2',id=50000c52-a791-4996-a81c-83a404023207,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-286502567',owner='673708a9f12541f6929c86eb60ca83c8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T22:18:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMYhFAiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ede2361a-e307-4f43-844c-b32b2ef6b4d7', 'attached_at': '', 'detached_at': '', 'volume_id': '4f4e2e23-a1b4-4864-b0a2-b7f15a10d986', 'serial': '4f4e2e23-a1b4-4864-b0a2-b7f15a10d986'}, 'attachment_id': '67fee8c0-7382-4e28-a6ec-6dfa3225d067', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:18:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:18:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T22:18:00Z,direct_url=<?>,disk_format='qcow2',id=50000c52-a791-4996-a81c-83a404023207,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-286502567',owner='673708a9f12541f6929c86eb60ca83c8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T22:18:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMYhFAiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:18:14 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:18:14 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:18:14 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfe41de-164d-4e26-8a7c-e1f23dc15047]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:18:14 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf0647-4f80-4e2c-b5fd-430529580266]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986] added
Nov 14 22:18:14 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5c1b39-04b1-4cb6-aecb-6d3c3c51d248]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[064aa1c5-c936-4e92-bfc7-a936bd792c6e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMYhFAiP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMYhFAiP" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[612ef3d0-6729-4b6f-9100-2eee6b8cc762]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMYhFAiP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba313228-7593-4bc3-af19-186fab1955fb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83ad85c-daf2-4fcb-8c68-1f58d6ecf4d4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e5b150-bd6e-4bbd-a64e-32705a56fd14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986, portal: 172.16.0.220,3260]
Nov 14 22:18:15 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986, portal: 172.16.0.220,3260] successful.
Nov 14 22:18:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaffd24-d17f-4657-b533-c5ce7cbf452b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b2d872-746f-455c-adf0-2d3304d33a9c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:18:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f66efc-18e5-47e8-9236-ffbd788124d0]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:18:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMYhFAiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26238336163343133', 'path': '/dev/sdf'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238336163343133', 'path': '/dev/sdf'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-662375112',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-662375112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-662375112',id=30,image_ref='50000c52-a791-4996-a81c-83a404023207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJWLTcdyXamUcSRw9mjNKbROa4hEtpzhDkOqtpNXKG2APkoqnVbsI/uatw7WQ4LvnRuDUxZ/WE2ddxm+ZNiJ0QDLKTWd8WiXiFzaJAIw8inn3WA9eiyIPENqLvmDxjLMg==',key_name='tempest-keypair-63621170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-d4fzicjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1821264948',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:18:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=ede2361a-e307-4f43-844c-b32b2ef6b4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:04:94,bridge_name='br-int',has_traffic_filtering=True,id=f303ac60-d3ea-41ed-a423-7de3f10c886f,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf303ac60-d3') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'pci_devices' on Instance uuid ede2361a-e307-4f43-844c-b32b2ef6b4d7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:18:16 user nova-compute[76815]:   <uuid>ede2361a-e307-4f43-844c-b32b2ef6b4d7</uuid>
Nov 14 22:18:16 user nova-compute[76815]:   <name>instance-0000001e</name>
Nov 14 22:18:16 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:18:16 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:18:16 user nova-compute[76815]:   <metadata>
Nov 14 22:18:16 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:18:16 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:18:16 user nova-compute[76815]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-662375112</nova:name>
Nov 14 22:18:16 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:18:14</nova:creationTime>
Nov 14 22:18:16 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:18:16 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:18:16 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:18:16 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:18:16 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:18:16 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:18:16 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:18:16 user nova-compute[76815]:       <nova:owner>
Nov 14 22:18:16 user nova-compute[76815]:         <nova:user uuid="0fd5c7c940b0429994db55b93cb421ed">tempest-TestVolumeBootPattern-1821264948-project-member</nova:user>
Nov 14 22:18:16 user nova-compute[76815]:         <nova:project uuid="673708a9f12541f6929c86eb60ca83c8">tempest-TestVolumeBootPattern-1821264948</nova:project>
Nov 14 22:18:16 user nova-compute[76815]:       </nova:owner>
Nov 14 22:18:16 user nova-compute[76815]:       <nova:root type="image" uuid="50000c52-a791-4996-a81c-83a404023207"/>
Nov 14 22:18:16 user nova-compute[76815]:       <nova:ports>
Nov 14 22:18:16 user nova-compute[76815]:         <nova:port uuid="f303ac60-d3ea-41ed-a423-7de3f10c886f">
Nov 14 22:18:16 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 22:18:16 user nova-compute[76815]:         </nova:port>
Nov 14 22:18:16 user nova-compute[76815]:       </nova:ports>
Nov 14 22:18:16 user nova-compute[76815]:     </nova:instance>
Nov 14 22:18:16 user nova-compute[76815]:   </metadata>
Nov 14 22:18:16 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:18:16 user nova-compute[76815]:     <system>
Nov 14 22:18:16 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:18:16 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:18:16 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:18:16 user nova-compute[76815]:       <entry name="serial">ede2361a-e307-4f43-844c-b32b2ef6b4d7</entry>
Nov 14 22:18:16 user nova-compute[76815]:       <entry name="uuid">ede2361a-e307-4f43-844c-b32b2ef6b4d7</entry>
Nov 14 22:18:16 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:18:16 user nova-compute[76815]:     </system>
Nov 14 22:18:16 user nova-compute[76815]:   </sysinfo>
Nov 14 22:18:16 user nova-compute[76815]:   <os>
Nov 14 22:18:16 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:18:16 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:18:16 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:18:16 user nova-compute[76815]:   </os>
Nov 14 22:18:16 user nova-compute[76815]:   <features>
Nov 14 22:18:16 user nova-compute[76815]:     <acpi/>
Nov 14 22:18:16 user nova-compute[76815]:     <apic/>
Nov 14 22:18:16 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:18:16 user nova-compute[76815]:   </features>
Nov 14 22:18:16 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:18:16 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:18:16 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:18:16 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:18:16 user nova-compute[76815]:   </clock>
Nov 14 22:18:16 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:18:16 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:18:16 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:18:16 user nova-compute[76815]:   </cpu>
Nov 14 22:18:16 user nova-compute[76815]:   <devices>
Nov 14 22:18:16 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:18:16 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:18:16 user nova-compute[76815]:       <source dev="/dev/sdf"/>
Nov 14 22:18:16 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:18:16 user nova-compute[76815]:       <serial>4f4e2e23-a1b4-4864-b0a2-b7f15a10d986</serial>
Nov 14 22:18:16 user nova-compute[76815]:     </disk>
Nov 14 22:18:16 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:18:16 user nova-compute[76815]:       <mac address="fa:16:3e:d5:04:94"/>
Nov 14 22:18:16 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:18:16 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:18:16 user nova-compute[76815]:       <target dev="tapf303ac60-d3"/>
Nov 14 22:18:16 user nova-compute[76815]:     </interface>
Nov 14 22:18:16 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:18:16 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/ede2361a-e307-4f43-844c-b32b2ef6b4d7/console.log" append="off"/>
Nov 14 22:18:16 user nova-compute[76815]:     </serial>
Nov 14 22:18:16 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:18:16 user nova-compute[76815]:     <video>
Nov 14 22:18:16 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:18:16 user nova-compute[76815]:     </video>
Nov 14 22:18:16 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:18:16 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:18:16 user nova-compute[76815]:     </rng>
Nov 14 22:18:16 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:18:16 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:18:16 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:18:16 user nova-compute[76815]:     </memballoon>
Nov 14 22:18:16 user nova-compute[76815]:   </devices>
Nov 14 22:18:16 user nova-compute[76815]: </domain>
Nov 14 22:18:16 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-662375112',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-662375112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-662375112',id=30,image_ref='50000c52-a791-4996-a81c-83a404023207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJWLTcdyXamUcSRw9mjNKbROa4hEtpzhDkOqtpNXKG2APkoqnVbsI/uatw7WQ4LvnRuDUxZ/WE2ddxm+ZNiJ0QDLKTWd8WiXiFzaJAIw8inn3WA9eiyIPENqLvmDxjLMg==',key_name='tempest-keypair-63621170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-d4fzicjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1821264948',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:18:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=ede2361a-e307-4f43-844c-b32b2ef6b4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:04:94,bridge_name='br-int',has_traffic_filtering=True,id=f303ac60-d3ea-41ed-a423-7de3f10c886f,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf303ac60-d3') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG os_vif [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:04:94,bridge_name='br-int',has_traffic_filtering=True,id=f303ac60-d3ea-41ed-a423-7de3f10c886f,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf303ac60-d3') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57890317-3465-5197-81ef-46a32c26c721', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf303ac60-d3, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf303ac60-d3, col_values=(('qos', UUID('4fffabfe-be96-46c7-9e98-8bfd6efdf371')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf303ac60-d3, col_values=(('external_ids', {'iface-id': 'f303ac60-d3ea-41ed-a423-7de3f10c886f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:04:94', 'vm-uuid': 'ede2361a-e307-4f43-844c-b32b2ef6b4d7'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:16 user nova-compute[76815]: INFO os_vif [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:04:94,bridge_name='br-int',has_traffic_filtering=True,id=f303ac60-d3ea-41ed-a423-7de3f10c886f,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf303ac60-d3')
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No VIF found with MAC fa:16:3e:d5:04:94, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:18:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-d7ee44a6-4078-476a-88b0-d5d9deff3c97 req-b6fe3e41-6623-4b9c-bc51-ad381342e0ef service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received event network-vif-plugged-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d7ee44a6-4078-476a-88b0-d5d9deff3c97 req-b6fe3e41-6623-4b9c-bc51-ad381342e0ef service nova] Acquiring lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d7ee44a6-4078-476a-88b0-d5d9deff3c97 req-b6fe3e41-6623-4b9c-bc51-ad381342e0ef service nova] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d7ee44a6-4078-476a-88b0-d5d9deff3c97 req-b6fe3e41-6623-4b9c-bc51-ad381342e0ef service nova] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-d7ee44a6-4078-476a-88b0-d5d9deff3c97 req-b6fe3e41-6623-4b9c-bc51-ad381342e0ef service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] No waiting events found dispatching network-vif-plugged-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:18:17 user nova-compute[76815]: WARNING nova.compute.manager [req-d7ee44a6-4078-476a-88b0-d5d9deff3c97 req-b6fe3e41-6623-4b9c-bc51-ad381342e0ef service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received unexpected event network-vif-plugged-f303ac60-d3ea-41ed-a423-7de3f10c886f for instance with vm_state building and task_state spawning.
Nov 14 22:18:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:18:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:18:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Instance spawned successfully.
Nov 14 22:18:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:18:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:18:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:18:19 user nova-compute[76815]: INFO nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 14 22:18:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:18:19 user nova-compute[76815]: INFO nova.compute.manager [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Took 15.98 seconds to build instance.
Nov 14 22:18:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-5cd62832-f099-424f-a2ee-6f920c4a7b19 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.076s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-02203169-d566-40e5-b603-b018003e7555 req-2ef4ddaa-d2f2-4715-aa12-14b47355e632 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received event network-vif-plugged-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:18:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-02203169-d566-40e5-b603-b018003e7555 req-2ef4ddaa-d2f2-4715-aa12-14b47355e632 service nova] Acquiring lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-02203169-d566-40e5-b603-b018003e7555 req-2ef4ddaa-d2f2-4715-aa12-14b47355e632 service nova] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-02203169-d566-40e5-b603-b018003e7555 req-2ef4ddaa-d2f2-4715-aa12-14b47355e632 service nova] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-02203169-d566-40e5-b603-b018003e7555 req-2ef4ddaa-d2f2-4715-aa12-14b47355e632 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] No waiting events found dispatching network-vif-plugged-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:18:19 user nova-compute[76815]: WARNING nova.compute.manager [req-02203169-d566-40e5-b603-b018003e7555 req-2ef4ddaa-d2f2-4715-aa12-14b47355e632 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received unexpected event network-vif-plugged-f303ac60-d3ea-41ed-a423-7de3f10c886f for instance with vm_state active and task_state None.
Nov 14 22:18:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:32 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:32 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01f81d12-add4-448c-a257-42a90c9e833d is timed out.
Nov 14 22:18:32 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Successfully detached device vdb from instance 01f81d12-add4-448c-a257-42a90c9e833d from the live domain config.
Nov 14 22:18:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:18:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOstuiUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:18:32 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:18:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:18:32 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:18:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a68122-bc4b-40ef-92db-dc41182fdf20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:18:33 user nova-compute[76815]: No targets found.
Nov 14 22:18:33 user nova-compute[76815]: iSNS:
Nov 14 22:18:33 user nova-compute[76815]: No targets found.
Nov 14 22:18:33 user nova-compute[76815]: STATIC:
Nov 14 22:18:33 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:18:33 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:18:33 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:18:33 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986
Nov 14 22:18:33 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:18:33 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:18:33 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa
Nov 14 22:18:33 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:18:33 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:18:33 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:18:33 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:18:33 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:18:33 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508
Nov 14 22:18:33 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:18:33 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:18:33 user nova-compute[76815]: FIRMWARE:
Nov 14 22:18:33 user nova-compute[76815]: No targets found.
Nov 14 22:18:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:18:33 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:18:33 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7564cbe4-db35-4543-bed6-8cb8a5c0c791]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eaeaba-31eb-4a63-9844-551866e1f7f8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:33 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:33 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:33 user nova-compute[76815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)
Nov 14 22:18:33 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:18:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:33 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:33 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:33 user nova-compute[76815]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 (non-flash)
Nov 14 22:18:33 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:18:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a477ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508'): ({'sde'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Removing single pathed devices sde {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8992cb-9ea2-4b8f-a0c4-9085140e0402]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1face113-9cdb-456a-91b7-a5d7325d2ec7]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Flushing IO for device /dev/sde {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40551087-4d6b-4ebe-b28a-c6810392d360]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9416db8-c7aa-42b3-8ac7-79346f9bcc56]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe3bcbf-09de-4fd4-8516-7a07b3665005]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a80af7-bca6-499a-86e1-81de4eb4fb7f]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508, portal: 172.16.0.220,3260]
Nov 14 22:18:33 user nova-compute[76815]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508, portal: 172.16.0.220,3260] successful.
Nov 14 22:18:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2cc7929-f02d-4c48-b2e7-34a32b983508 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc955dae-ebae-4a23-823b-2d63d1edfa3f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] <== disconnect_volume: return (310ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:18:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:18:34 user nova-compute[76815]: DEBUG nova.objects.instance [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'flavor' on Instance uuid 01f81d12-add4-448c-a257-42a90c9e833d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:18:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-59ad086e-6450-4ea5-ba06-582a5f2d01dd tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.631s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-857f37a3-69e2-45c5-83c4-63e1939343cf req-bc69602d-f041-431e-8a19-1b17664a7e86 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received event network-changed-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-857f37a3-69e2-45c5-83c4-63e1939343cf req-bc69602d-f041-431e-8a19-1b17664a7e86 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Refreshing instance network info cache due to event network-changed-54bd8c17-61f2-4d38-accb-b293d98aa056. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-857f37a3-69e2-45c5-83c4-63e1939343cf req-bc69602d-f041-431e-8a19-1b17664a7e86 service nova] Acquiring lock "refresh_cache-0c84b4a2-e57c-420d-a184-72e493c936ae" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-857f37a3-69e2-45c5-83c4-63e1939343cf req-bc69602d-f041-431e-8a19-1b17664a7e86 service nova] Acquired lock "refresh_cache-0c84b4a2-e57c-420d-a184-72e493c936ae" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-857f37a3-69e2-45c5-83c4-63e1939343cf req-bc69602d-f041-431e-8a19-1b17664a7e86 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Refreshing network info cache for port 54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG nova.objects.instance [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'flavor' on Instance uuid 0c84b4a2-e57c-420d-a184-72e493c936ae {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:18:35 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Ignoring supplied device name: /dev/vdb
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.395s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:35 user nova-compute[76815]: INFO nova.compute.manager [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Attaching volume 1715d082-53b5-4142-9d71-8949040750eb to /dev/vdb
Nov 14 22:18:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-857f37a3-69e2-45c5-83c4-63e1939343cf req-bc69602d-f041-431e-8a19-1b17664a7e86 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Updated VIF entry in instance network info cache for port 54bd8c17-61f2-4d38-accb-b293d98aa056. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-857f37a3-69e2-45c5-83c4-63e1939343cf req-bc69602d-f041-431e-8a19-1b17664a7e86 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Updating instance_info_cache with network_info: [{"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG os_brick.utils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-857f37a3-69e2-45c5-83c4-63e1939343cf req-bc69602d-f041-431e-8a19-1b17664a7e86 service nova] Releasing lock "refresh_cache-0c84b4a2-e57c-420d-a184-72e493c936ae" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bef664-e08e-4253-a9bb-5baa48dbbcb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5b3573-46fc-4039-b16a-967e062bdcde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b1d439-30c1-4953-9f93-e1a075905747]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b7e318-8f54-4798-84cb-8dbd9a46c2ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:18:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:18:36 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c2238f-2d96-4fb2-af17-c21694d0e709]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG os_brick.utils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Updating existing volume attachment record: 1aad5bb5-aaac-40f8-882c-420480bf6c4f {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:18:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:18:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7294MB free_disk=25.04397201538086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:18:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0dc9077f-493b-44b7-bfde-1d448ae001fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bc3a520b-21e4-463e-a39d-a397c3e6b811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 59178f91-5932-41b5-9e21-7c2401be86ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 01f81d12-add4-448c-a257-42a90c9e833d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0c84b4a2-e57c-420d-a184-72e493c936ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 9e076b98-3f30-4a9a-aa97-330c748de261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 85f255af-70de-47c0-bc23-e3957542b150 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ede2361a-e307-4f43-844c-b32b2ef6b4d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bAgcRVBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:18:40 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:18:40 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:18:40 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d78d48-53f1-4c9d-b5c9-50d738ea1e75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:18:40 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ea661f-684f-40fa-bb91-59e9dd787e22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb] added
Nov 14 22:18:40 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd04e4-1e68-4577-afc1-e16280b1aa43]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a73999-f29c-4ebc-b98c-d84bcac65db9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bAgcRVBr {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bAgcRVBr" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c20dde-b6d4-4daa-862b-5cae891315de]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bAgcRVBr'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbdc835-f35e-4ac5-a4c7-06c405334fc3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e582065b-76de-410d-804a-4bd81c0193d2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:18:40 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:18:40 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f51dcaa-d583-464a-a5e9-28eee654422b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb, portal: 172.16.0.220,3260]
Nov 14 22:18:40 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb, portal: 172.16.0.220,3260] successful.
Nov 14 22:18:40 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8228f25e-84b7-4ff1-bac4-b3374339c214]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a8aec3-2d2b-48b4-92cc-bcfc41bec164]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb (non-flash)
Nov 14 22:18:40 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:18:40 user nova-compute[76815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb (non-flash)
Nov 14 22:18:40 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5164428-0e38-41fa-9a1a-0de209a2905b]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:18:40 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bAgcRVBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26137643764656564', 'path': '/dev/sde'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137643764656564', 'path': '/dev/sde'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG nova.objects.instance [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'flavor' on Instance uuid 0c84b4a2-e57c-420d-a184-72e493c936ae {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:18:41 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:18:41 user nova-compute[76815]:   <source dev="/dev/sde"/>
Nov 14 22:18:41 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:18:41 user nova-compute[76815]:   <serial>1715d082-53b5-4142-9d71-8949040750eb</serial>
Nov 14 22:18:41 user nova-compute[76815]: </disk>
Nov 14 22:18:41 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:18:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:18:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:18:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] No VIF found with MAC fa:16:3e:49:70:74, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:18:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-743cfbfd-8ef2-4f58-924f-6c86f891648f tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.429s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:18:43 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:45 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:18:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:18:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:18:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:18:49 user nova-compute[76815]: INFO nova.compute.manager [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Detaching volume 1715d082-53b5-4142-9d71-8949040750eb
Nov 14 22:18:49 user nova-compute[76815]: INFO nova.virt.block_device [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Attempting to driver detach volume 1715d082-53b5-4142-9d71-8949040750eb from mountpoint /dev/vdb
Nov 14 22:18:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Attempting to detach device vdb from instance 0c84b4a2-e57c-420d-a184-72e493c936ae from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:18:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:18:49 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:18:49 user nova-compute[76815]:   <source dev="/dev/sde"/>
Nov 14 22:18:49 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:18:49 user nova-compute[76815]:   <serial>1715d082-53b5-4142-9d71-8949040750eb</serial>
Nov 14 22:18:49 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:18:49 user nova-compute[76815]: </disk>
Nov 14 22:18:49 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:18:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Successfully detached device vdb from instance 0c84b4a2-e57c-420d-a184-72e493c936ae from the persistent domain config.
Nov 14 22:18:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c84b4a2-e57c-420d-a184-72e493c936ae from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:18:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:18:49 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:18:49 user nova-compute[76815]:   <source dev="/dev/sde"/>
Nov 14 22:18:49 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:18:49 user nova-compute[76815]:   <serial>1715d082-53b5-4142-9d71-8949040750eb</serial>
Nov 14 22:18:49 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:18:49 user nova-compute[76815]: </disk>
Nov 14 22:18:49 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:18:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:18:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c84b4a2-e57c-420d-a184-72e493c936ae {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:18:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:18:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-2951d2a9-5b66-4127-ac67-8e2018ddd5dc req-07a557bb-6434-461d-a6c1-3bdbf012beff service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received event network-changed-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-2951d2a9-5b66-4127-ac67-8e2018ddd5dc req-07a557bb-6434-461d-a6c1-3bdbf012beff service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Refreshing instance network info cache due to event network-changed-3801d538-e087-498b-8bee-5759b04d9117. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2951d2a9-5b66-4127-ac67-8e2018ddd5dc req-07a557bb-6434-461d-a6c1-3bdbf012beff service nova] Acquiring lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2951d2a9-5b66-4127-ac67-8e2018ddd5dc req-07a557bb-6434-461d-a6c1-3bdbf012beff service nova] Acquired lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.network.neutron [req-2951d2a9-5b66-4127-ac67-8e2018ddd5dc req-07a557bb-6434-461d-a6c1-3bdbf012beff service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Refreshing network info cache for port 3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:03 user nova-compute[76815]: INFO nova.compute.manager [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Terminating instance
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-24bfeed2-325a-4c5d-ab79-2fcb30a8352d req-50ca1655-04e0-444f-ac6e-c31ef8ea7fca service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received event network-vif-unplugged-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-24bfeed2-325a-4c5d-ab79-2fcb30a8352d req-50ca1655-04e0-444f-ac6e-c31ef8ea7fca service nova] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-24bfeed2-325a-4c5d-ab79-2fcb30a8352d req-50ca1655-04e0-444f-ac6e-c31ef8ea7fca service nova] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-24bfeed2-325a-4c5d-ab79-2fcb30a8352d req-50ca1655-04e0-444f-ac6e-c31ef8ea7fca service nova] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-24bfeed2-325a-4c5d-ab79-2fcb30a8352d req-50ca1655-04e0-444f-ac6e-c31ef8ea7fca service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] No waiting events found dispatching network-vif-unplugged-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-24bfeed2-325a-4c5d-ab79-2fcb30a8352d req-50ca1655-04e0-444f-ac6e-c31ef8ea7fca service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received event network-vif-unplugged-3801d538-e087-498b-8bee-5759b04d9117 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.network.neutron [req-2951d2a9-5b66-4127-ac67-8e2018ddd5dc req-07a557bb-6434-461d-a6c1-3bdbf012beff service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Updated VIF entry in instance network info cache for port 3801d538-e087-498b-8bee-5759b04d9117. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.network.neutron [req-2951d2a9-5b66-4127-ac67-8e2018ddd5dc req-07a557bb-6434-461d-a6c1-3bdbf012beff service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Updating instance_info_cache with network_info: [{"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2951d2a9-5b66-4127-ac67-8e2018ddd5dc req-07a557bb-6434-461d-a6c1-3bdbf012beff service nova] Releasing lock "refresh_cache-01f81d12-add4-448c-a257-42a90c9e833d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Instance destroyed successfully.
Nov 14 22:19:03 user nova-compute[76815]: DEBUG nova.objects.instance [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'resources' on Instance uuid 01f81d12-add4-448c-a257-42a90c9e833d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1619379568',display_name='tempest-TestStampPattern-server-1619379568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1619379568',id=26,image_ref='404a69b9-c2ea-4f17-ad90-1b680b09fd0c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIz7adDgP7X73sp1hk5zQagIy7YAy0++VDgbZ8Zj9KPV4CgTwfipeuF7/mA4SwM5VVflsdyyENIt6u4cntTENc7drNh/bLAHBUCOpidpzrADFvxpLgpN2YTtL81gY4jTQ==',key_name='tempest-TestStampPattern-197761174',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='202f1749bf684dbfa082a1bf1eee2b2e',ramdisk_id='',reservation_id='r-x9ye0tse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0dc9077f-493b-44b7-bfde-1d448ae001fd',image_min_disk='1',image_min_ram='0',image_owner_id='202f1749bf684dbfa082a1bf1eee2b2e',image_owner_project_name='tempest-TestStampPattern-1059321344',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1059321344-project-member',image_user_id='6a7d3c7ad83543cbafc5e5ebcc2e7a01',owner_project_name='tempest-TestStampPattern-1059321344',owner_user_name='tempest-TestStampPattern-1059321344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:16:20Z,user_data=None,user_id='6a7d3c7ad83543cbafc5e5ebcc2e7a01',uuid=01f81d12-add4-448c-a257-42a90c9e833d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converting VIF {"id": "3801d538-e087-498b-8bee-5759b04d9117", "address": "fa:16:3e:d0:31:49", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3801d538-e0", "ovs_interfaceid": "3801d538-e087-498b-8bee-5759b04d9117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:31:49,bridge_name='br-int',has_traffic_filtering=True,id=3801d538-e087-498b-8bee-5759b04d9117,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3801d538-e0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG os_vif [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:31:49,bridge_name='br-int',has_traffic_filtering=True,id=3801d538-e087-498b-8bee-5759b04d9117,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3801d538-e0') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3801d538-e0, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24573e2a-8212-40f7-8aa1-c7494387bd59) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:04 user nova-compute[76815]: INFO os_vif [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:31:49,bridge_name='br-int',has_traffic_filtering=True,id=3801d538-e087-498b-8bee-5759b04d9117,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3801d538-e0')
Nov 14 22:19:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Deleting instance files /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d_del
Nov 14 22:19:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Deletion of /opt/stack/data/nova/instances/01f81d12-add4-448c-a257-42a90c9e833d_del complete
Nov 14 22:19:04 user nova-compute[76815]: INFO nova.compute.manager [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 22:19:04 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:04 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Took 0.44 seconds to deallocate network for instance.
Nov 14 22:19:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:19:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:04 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Deleted allocations for instance 01f81d12-add4-448c-a257-42a90c9e833d
Nov 14 22:19:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-75984074-d148-4a6c-81b9-b4d6b182d770 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "01f81d12-add4-448c-a257-42a90c9e833d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.852s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-62bfd8dd-4b20-4d97-9cae-80f6851e1c1c req-1f7609dd-3e54-42b6-8aca-ffa9c19026ec service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received event network-vif-plugged-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62bfd8dd-4b20-4d97-9cae-80f6851e1c1c req-1f7609dd-3e54-42b6-8aca-ffa9c19026ec service nova] Acquiring lock "01f81d12-add4-448c-a257-42a90c9e833d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62bfd8dd-4b20-4d97-9cae-80f6851e1c1c req-1f7609dd-3e54-42b6-8aca-ffa9c19026ec service nova] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-62bfd8dd-4b20-4d97-9cae-80f6851e1c1c req-1f7609dd-3e54-42b6-8aca-ffa9c19026ec service nova] Lock "01f81d12-add4-448c-a257-42a90c9e833d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-62bfd8dd-4b20-4d97-9cae-80f6851e1c1c req-1f7609dd-3e54-42b6-8aca-ffa9c19026ec service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] No waiting events found dispatching network-vif-plugged-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:05 user nova-compute[76815]: WARNING nova.compute.manager [req-62bfd8dd-4b20-4d97-9cae-80f6851e1c1c req-1f7609dd-3e54-42b6-8aca-ffa9c19026ec service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received unexpected event network-vif-plugged-3801d538-e087-498b-8bee-5759b04d9117 for instance with vm_state deleted and task_state None.
Nov 14 22:19:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-62bfd8dd-4b20-4d97-9cae-80f6851e1c1c req-1f7609dd-3e54-42b6-8aca-ffa9c19026ec service nova] [instance: 01f81d12-add4-448c-a257-42a90c9e833d] Received event network-vif-deleted-3801d538-e087-498b-8bee-5759b04d9117 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:06 user nova-compute[76815]: INFO nova.compute.manager [None req-8ca1270d-3213-48d8-9357-6d2d047fe1d4 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Unrescuing
Nov 14 22:19:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ca1270d-3213-48d8-9357-6d2d047fe1d4 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ca1270d-3213-48d8-9357-6d2d047fe1d4 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquired lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:06 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8ca1270d-3213-48d8-9357-6d2d047fe1d4 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:19:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG nova.network.neutron [None req-8ca1270d-3213-48d8-9357-6d2d047fe1d4 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updating instance_info_cache with network_info: [{"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ca1270d-3213-48d8-9357-6d2d047fe1d4 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Releasing lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG nova.objects.instance [None req-8ca1270d-3213-48d8-9357-6d2d047fe1d4 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'flavor' on Instance uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-127e8b8c-fd46-439c-8b4d-f871b25da9e7 req-30968860-c5a2-4428-8aea-7b4eb0dc19b0 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-unplugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-127e8b8c-fd46-439c-8b4d-f871b25da9e7 req-30968860-c5a2-4428-8aea-7b4eb0dc19b0 service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-127e8b8c-fd46-439c-8b4d-f871b25da9e7 req-30968860-c5a2-4428-8aea-7b4eb0dc19b0 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-127e8b8c-fd46-439c-8b4d-f871b25da9e7 req-30968860-c5a2-4428-8aea-7b4eb0dc19b0 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG nova.compute.manager [req-127e8b8c-fd46-439c-8b4d-f871b25da9e7 req-30968860-c5a2-4428-8aea-7b4eb0dc19b0 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-unplugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:07 user nova-compute[76815]: WARNING nova.compute.manager [req-127e8b8c-fd46-439c-8b4d-f871b25da9e7 req-30968860-c5a2-4428-8aea-7b4eb0dc19b0 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-unplugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:19:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Instance destroyed successfully.
Nov 14 22:19:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:09 user nova-compute[76815]: WARNING nova.compute.manager [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:19:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG nova.compute.manager [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:09 user nova-compute[76815]: WARNING nova.compute.manager [req-cc172c18-1633-4038-a846-e6b734b2f69a req-2bcaecc1-d9fe-4b10-af27-34e69873961b service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:19:09 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0c84b4a2-e57c-420d-a184-72e493c936ae is timed out.
Nov 14 22:19:09 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Successfully detached device vdb from instance 0c84b4a2-e57c-420d-a184-72e493c936ae from the live domain config.
Nov 14 22:19:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bAgcRVBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:19:09 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a26e910-3457-4fc1-ba1a-81d69c110e22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:19:09 user nova-compute[76815]: No targets found.
Nov 14 22:19:09 user nova-compute[76815]: iSNS:
Nov 14 22:19:09 user nova-compute[76815]: No targets found.
Nov 14 22:19:09 user nova-compute[76815]: STATIC:
Nov 14 22:19:09 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:19:09 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:09 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:09 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986
Nov 14 22:19:09 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:09 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:09 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa
Nov 14 22:19:09 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:09 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:09 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:19:09 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:09 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:09 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb
Nov 14 22:19:09 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:09 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:09 user nova-compute[76815]: FIRMWARE:
Nov 14 22:19:09 user nova-compute[76815]: No targets found.
Nov 14 22:19:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:19:09 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:19:09 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bc36b6-c9be-4122-a09a-141d9a8bdf3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[074e03ea-baa1-423c-9f78-954b4b1ff97e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:09 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:09 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:09 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:09 user nova-compute[76815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb (non-flash)
Nov 14 22:19:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:09 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:09 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:09 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:09 user nova-compute[76815]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb (non-flash)
Nov 14 22:19:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4535480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb'): ({'sde'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Removing single pathed devices sde {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63b2151-e3a4-4059-a640-c5113ed3fde7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfec0d1-7f12-42af-956a-1eea4da01301]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Flushing IO for device /dev/sde {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:19:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bf618b-a649-440d-a9e3-b1bea8302a23]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8d1f41-0942-407f-a980-1e0cda277477]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4018e9a5-ba16-4c8f-b73a-2817b9abdb4f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2809828f-546f-4855-83d7-b22cd141cb3f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb, portal: 172.16.0.220,3260]
Nov 14 22:19:10 user nova-compute[76815]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb, portal: 172.16.0.220,3260] successful.
Nov 14 22:19:10 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[572c37a3-e264-4712-8d37-824df0b63378]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] <== disconnect_volume: return (325ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG nova.objects.instance [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'flavor' on Instance uuid 0c84b4a2-e57c-420d-a184-72e493c936ae {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ba5ff7d9-f267-44fe-a650-6e531adb0284 tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.508s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:10 user nova-compute[76815]: INFO nova.compute.manager [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Terminating instance
Nov 14 22:19:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-4ca2c9ad-1c79-48a3-baf4-892c34b10745 req-43e5199b-495c-4e93-9f07-f6ed3fb4021a service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received event network-vif-unplugged-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4ca2c9ad-1c79-48a3-baf4-892c34b10745 req-43e5199b-495c-4e93-9f07-f6ed3fb4021a service nova] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4ca2c9ad-1c79-48a3-baf4-892c34b10745 req-43e5199b-495c-4e93-9f07-f6ed3fb4021a service nova] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4ca2c9ad-1c79-48a3-baf4-892c34b10745 req-43e5199b-495c-4e93-9f07-f6ed3fb4021a service nova] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-4ca2c9ad-1c79-48a3-baf4-892c34b10745 req-43e5199b-495c-4e93-9f07-f6ed3fb4021a service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] No waiting events found dispatching network-vif-unplugged-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-4ca2c9ad-1c79-48a3-baf4-892c34b10745 req-43e5199b-495c-4e93-9f07-f6ed3fb4021a service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received event network-vif-unplugged-54bd8c17-61f2-4d38-accb-b293d98aa056 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8ca1270d-3213-48d8-9357-6d2d047fe1d4 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-0caa2612-17bf-4e2f-92de-49de909009a1 req-0abb7063-ab6b-406a-9cb6-168ec1125aa2 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0caa2612-17bf-4e2f-92de-49de909009a1 req-0abb7063-ab6b-406a-9cb6-168ec1125aa2 service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0caa2612-17bf-4e2f-92de-49de909009a1 req-0abb7063-ab6b-406a-9cb6-168ec1125aa2 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0caa2612-17bf-4e2f-92de-49de909009a1 req-0abb7063-ab6b-406a-9cb6-168ec1125aa2 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-0caa2612-17bf-4e2f-92de-49de909009a1 req-0abb7063-ab6b-406a-9cb6-168ec1125aa2 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:11 user nova-compute[76815]: WARNING nova.compute.manager [req-0caa2612-17bf-4e2f-92de-49de909009a1 req-0abb7063-ab6b-406a-9cb6-168ec1125aa2 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:19:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Instance destroyed successfully.
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.objects.instance [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lazy-loading 'resources' on Instance uuid 0c84b4a2-e57c-420d-a184-72e493c936ae {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1422902193',display_name='tempest-VolumesSnapshotTestJSON-instance-1422902193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1422902193',id=27,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsBY+7bpzCaRr2caZXw/CNIok/PGr3+eWjBEFf+0/T2qZH/FZTbVd47gODSoDqLficdMlztGI95fxnNWWfgOBGo7X7XAZdPEb4rx4pBRiPJ/2Sz2RiwV5FuTmXnJY91Mw==',key_name='tempest-keypair-302963638',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:16:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47a8307d87eb4927b49944f0a0055ef1',ramdisk_id='',reservation_id='r-figdqu2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1321856389',owner_user_name='tempest-VolumesSnapshotTestJSON-1321856389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c67499628cb4369bc042f00b6a4303b',uuid=0c84b4a2-e57c-420d-a184-72e493c936ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converting VIF {"id": "54bd8c17-61f2-4d38-accb-b293d98aa056", "address": "fa:16:3e:49:70:74", "network": {"id": "d45c8bea-29e7-4694-8cce-b2ce509fbd0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1613318442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47a8307d87eb4927b49944f0a0055ef1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54bd8c17-61", "ovs_interfaceid": "54bd8c17-61f2-4d38-accb-b293d98aa056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:70:74,bridge_name='br-int',has_traffic_filtering=True,id=54bd8c17-61f2-4d38-accb-b293d98aa056,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54bd8c17-61') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_vif [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:70:74,bridge_name='br-int',has_traffic_filtering=True,id=54bd8c17-61f2-4d38-accb-b293d98aa056,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54bd8c17-61') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54bd8c17-61, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ce69c97-310e-4a54-b211-78c0f8672c1e) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: INFO os_vif [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:70:74,bridge_name='br-int',has_traffic_filtering=True,id=54bd8c17-61f2-4d38-accb-b293d98aa056,network=Network(d45c8bea-29e7-4694-8cce-b2ce509fbd0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54bd8c17-61')
Nov 14 22:19:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bAgcRVBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:19:11 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047b6c9-04f1-4b3c-ba5f-674d29801ff1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:19:11 user nova-compute[76815]: No targets found.
Nov 14 22:19:11 user nova-compute[76815]: iSNS:
Nov 14 22:19:11 user nova-compute[76815]: No targets found.
Nov 14 22:19:11 user nova-compute[76815]: STATIC:
Nov 14 22:19:11 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:19:11 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:11 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:11 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986
Nov 14 22:19:11 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:11 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:11 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa
Nov 14 22:19:11 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:11 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:11 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:19:11 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:11 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:11 user nova-compute[76815]: FIRMWARE:
Nov 14 22:19:11 user nova-compute[76815]: No targets found.
Nov 14 22:19:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:19:11 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:19:11 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1715d082-53b5-4142-9d71-8949040750eb', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[08255f2c-d209-4fe5-b1f5-a7c1bfec0c35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[535da062-2741-49c0-914d-537afdd12d7e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:11 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:11 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:11 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:11 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:11 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:11 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8395900>, {}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Disconnecting from: [] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:19:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:19:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] <== disconnect_volume: return (72ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:19:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:19:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Deleting instance files /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae_del
Nov 14 22:19:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Deletion of /opt/stack/data/nova/instances/0c84b4a2-e57c-420d-a184-72e493c936ae_del complete
Nov 14 22:19:12 user nova-compute[76815]: INFO nova.compute.manager [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 14 22:19:12 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:19:12 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:19:12 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:19:12 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:12 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Took 0.78 seconds to deallocate network for instance.
Nov 14 22:19:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-683b3eb4-f220-4b67-84e8-9e7e5ac5a768 req-c362b485-27ac-4530-a46e-8f458c867be2 service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received event network-vif-deleted-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:12 user nova-compute[76815]: WARNING nova.volume.cinder [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Attachment 1aad5bb5-aaac-40f8-882c-420480bf6c4f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1aad5bb5-aaac-40f8-882c-420480bf6c4f. (HTTP 404) (Request-ID: req-4c7824fd-3f58-4171-a5d1-cfe8ba0741db)
Nov 14 22:19:12 user nova-compute[76815]: INFO nova.compute.manager [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 22:19:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received event network-vif-plugged-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] Acquiring lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] No waiting events found dispatching network-vif-plugged-54bd8c17-61f2-4d38-accb-b293d98aa056 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:13 user nova-compute[76815]: WARNING nova.compute.manager [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] [instance: 0c84b4a2-e57c-420d-a184-72e493c936ae] Received unexpected event network-vif-plugged-54bd8c17-61f2-4d38-accb-b293d98aa056 for instance with vm_state deleted and task_state None.
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-changed-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Refreshing instance network info cache due to event network-changed-49dbd78d-299e-4717-bf85-1a3ad0e83689. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] Acquiring lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] Acquired lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.network.neutron [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Refreshing network info cache for port 49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:13 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Deleted allocations for instance 0c84b4a2-e57c-420d-a184-72e493c936ae
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d83ca6d4-298f-4fe8-989f-d0045ce2d0cf tempest-VolumesSnapshotTestJSON-1321856389 tempest-VolumesSnapshotTestJSON-1321856389-project-member] Lock "0c84b4a2-e57c-420d-a184-72e493c936ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.476s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:13 user nova-compute[76815]: INFO nova.compute.manager [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] instance snapshotting
Nov 14 22:19:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Beginning live snapshot process
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.network.neutron [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updated VIF entry in instance network info cache for port 49dbd78d-299e-4717-bf85-1a3ad0e83689. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG nova.network.neutron [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating instance_info_cache with network_info: [{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json -f qcow2 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-30f8ce8a-89b2-4606-8f5c-63266300f79b req-0697a0c1-94a9-41dd-a0b8-4ba9f5e2c76b service nova] Releasing lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json -f qcow2 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph4gb8_ap/29104e0c4ac24c77a1d3e534d44dd590.delta 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph4gb8_ap/29104e0c4ac24c77a1d3e534d44dd590.delta 1073741824" returned: 0 in 0.052s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:14 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 22:19:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-4c22d34b-8bb9-41b5-b093-c1d44ab889ac req-d2307bb9-cdbb-4439-a2f5-a16fc192ac6a service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-changed-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-4c22d34b-8bb9-41b5-b093-c1d44ab889ac req-d2307bb9-cdbb-4439-a2f5-a16fc192ac6a service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Refreshing instance network info cache due to event network-changed-6a9c880b-50a5-4606-9fe5-1e6ad5172aee. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4c22d34b-8bb9-41b5-b093-c1d44ab889ac req-d2307bb9-cdbb-4439-a2f5-a16fc192ac6a service nova] Acquiring lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4c22d34b-8bb9-41b5-b093-c1d44ab889ac req-d2307bb9-cdbb-4439-a2f5-a16fc192ac6a service nova] Acquired lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-4c22d34b-8bb9-41b5-b093-c1d44ab889ac req-d2307bb9-cdbb-4439-a2f5-a16fc192ac6a service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Refreshing network info cache for port 6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:19:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 22:19:15 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph4gb8_ap/29104e0c4ac24c77a1d3e534d44dd590.delta /opt/stack/data/nova/instances/snapshots/tmph4gb8_ap/29104e0c4ac24c77a1d3e534d44dd590 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-4c22d34b-8bb9-41b5-b093-c1d44ab889ac req-d2307bb9-cdbb-4439-a2f5-a16fc192ac6a service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updated VIF entry in instance network info cache for port 6a9c880b-50a5-4606-9fe5-1e6ad5172aee. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-4c22d34b-8bb9-41b5-b093-c1d44ab889ac req-d2307bb9-cdbb-4439-a2f5-a16fc192ac6a service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating instance_info_cache with network_info: [{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4c22d34b-8bb9-41b5-b093-c1d44ab889ac req-d2307bb9-cdbb-4439-a2f5-a16fc192ac6a service nova] Releasing lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph4gb8_ap/29104e0c4ac24c77a1d3e534d44dd590.delta /opt/stack/data/nova/instances/snapshots/tmph4gb8_ap/29104e0c4ac24c77a1d3e534d44dd590" returned: 0 in 0.410s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Snapshot extracted, beginning image upload
Nov 14 22:19:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Snapshot image upload complete
Nov 14 22:19:18 user nova-compute[76815]: INFO nova.compute.manager [None req-4d3e9bd9-4dd2-4543-b179-f5970ae104f5 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Took 4.92 seconds to snapshot the instance on the hypervisor.
Nov 14 22:19:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:19 user nova-compute[76815]: INFO nova.compute.manager [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Shelving
Nov 14 22:19:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-79547369-0d83-4f7f-8b12-fa68ab0f3b85 req-8dff3065-bb3c-4f07-9d82-f5bea01b9aba service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-unplugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79547369-0d83-4f7f-8b12-fa68ab0f3b85 req-8dff3065-bb3c-4f07-9d82-f5bea01b9aba service nova] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79547369-0d83-4f7f-8b12-fa68ab0f3b85 req-8dff3065-bb3c-4f07-9d82-f5bea01b9aba service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79547369-0d83-4f7f-8b12-fa68ab0f3b85 req-8dff3065-bb3c-4f07-9d82-f5bea01b9aba service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-79547369-0d83-4f7f-8b12-fa68ab0f3b85 req-8dff3065-bb3c-4f07-9d82-f5bea01b9aba service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] No waiting events found dispatching network-vif-unplugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:19 user nova-compute[76815]: WARNING nova.compute.manager [req-79547369-0d83-4f7f-8b12-fa68ab0f3b85 req-8dff3065-bb3c-4f07-9d82-f5bea01b9aba service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received unexpected event network-vif-unplugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee for instance with vm_state active and task_state shelving.
Nov 14 22:19:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance destroyed successfully.
Nov 14 22:19:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Beginning cold snapshot process
Nov 14 22:19:19 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:19:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk /opt/stack/data/nova/instances/snapshots/tmprrd8ddvx/a667c4d85e9f4bbb9aa7b1b5b96be82c {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk /opt/stack/data/nova/instances/snapshots/tmprrd8ddvx/a667c4d85e9f4bbb9aa7b1b5b96be82c" returned: 0 in 0.306s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Snapshot extracted, beginning image upload
Nov 14 22:19:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-a0923c2e-91a5-4c2c-91f3-3e7be5118238 req-a67da32e-e706-462f-97a2-cc493e53d2ab service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a0923c2e-91a5-4c2c-91f3-3e7be5118238 req-a67da32e-e706-462f-97a2-cc493e53d2ab service nova] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a0923c2e-91a5-4c2c-91f3-3e7be5118238 req-a67da32e-e706-462f-97a2-cc493e53d2ab service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a0923c2e-91a5-4c2c-91f3-3e7be5118238 req-a67da32e-e706-462f-97a2-cc493e53d2ab service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-a0923c2e-91a5-4c2c-91f3-3e7be5118238 req-a67da32e-e706-462f-97a2-cc493e53d2ab service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] No waiting events found dispatching network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:21 user nova-compute[76815]: WARNING nova.compute.manager [req-a0923c2e-91a5-4c2c-91f3-3e7be5118238 req-a67da32e-e706-462f-97a2-cc493e53d2ab service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received unexpected event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 22:19:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:22 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Snapshot image upload complete
Nov 14 22:19:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:19:22 user nova-compute[76815]: INFO nova.compute.manager [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Shelve offloading
Nov 14 22:19:22 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance destroyed successfully.
Nov 14 22:19:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:19:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquired lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:22 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:19:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:22 user nova-compute[76815]: INFO nova.compute.manager [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Unshelving
Nov 14 22:19:23 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating instance_info_cache with network_info: [{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:23 user nova-compute[76815]: INFO nova.virt.block_device [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Booting with volume b98fed93-15d7-4f20-8532-1b940ef1834d at /dev/vda
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Releasing lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG os_brick.utils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33ba8ed-2ed0-4f46-a7e9-1529475440d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[835e324d-0bdd-4e93-be41-0b6a24ad8929]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e73daf-4d5f-48f2-9052-aa31bd845bea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98b6853-a138-421d-b272-d32afc08d71b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:19:23 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:19:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6f5a2e-26b2-4984-9bc3-38b9b3fed0b0]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG os_brick.utils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:19:23 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating existing volume attachment record: 99e13134-5c3c-4da8-a3a7-334410193c06 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:19:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance destroyed successfully.
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'resources' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-196113391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-196113391',id=29,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbC3aWMQKKo3fu9/qMLPqaAgfQycwIfVXXScjuHVNwhIdPP2P5zysFD+owiLum7T2lUISKMNWqu3Slgqxg4DGxJvWuksE48UQeUJ9YCAbYcMSiT6OZRwFTcMeuHw+SIGQ==',key_name='tempest-keypair-24643289',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-gin1akfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member',shelved_at='2023-11-14T22:19:22.521200',shelved_host='user',shelved_image_id='774cbdcf-e040-4b8d-8adf-8c768e4ceaff'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:19:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=85f255af-70de-47c0-bc23-e3957542b150,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG os_vif [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a9c880b-50, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-f06694c2-8b8a-436a-ad2d-d01d15d0c245 req-9974ea2f-1144-44ce-aef2-3b9305e76905 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-changed-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-f06694c2-8b8a-436a-ad2d-d01d15d0c245 req-9974ea2f-1144-44ce-aef2-3b9305e76905 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Refreshing instance network info cache due to event network-changed-6a9c880b-50a5-4606-9fe5-1e6ad5172aee. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f06694c2-8b8a-436a-ad2d-d01d15d0c245 req-9974ea2f-1144-44ce-aef2-3b9305e76905 service nova] Acquiring lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f06694c2-8b8a-436a-ad2d-d01d15d0c245 req-9974ea2f-1144-44ce-aef2-3b9305e76905 service nova] Acquired lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.network.neutron [req-f06694c2-8b8a-436a-ad2d-d01d15d0c245 req-9974ea2f-1144-44ce-aef2-3b9305e76905 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Refreshing network info cache for port 6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad6cef05-8e9d-4de5-b43a-583c0edaae9d) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:24 user nova-compute[76815]: INFO os_vif [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50')
Nov 14 22:19:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Deleting instance files /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150_del
Nov 14 22:19:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Deletion of /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150_del complete
Nov 14 22:19:24 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Deleted allocations for instance 85f255af-70de-47c0-bc23-e3957542b150
Nov 14 22:19:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'numa_topology' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.objects.base [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<85f255af-70de-47c0-bc23-e3957542b150> lazy-loaded attributes: resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.network.neutron [req-f06694c2-8b8a-436a-ad2d-d01d15d0c245 req-9974ea2f-1144-44ce-aef2-3b9305e76905 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updated VIF entry in instance network info cache for port 6a9c880b-50a5-4606-9fe5-1e6ad5172aee. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.network.neutron [req-f06694c2-8b8a-436a-ad2d-d01d15d0c245 req-9974ea2f-1144-44ce-aef2-3b9305e76905 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating instance_info_cache with network_info: [{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6a9c880b-50", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f06694c2-8b8a-436a-ad2d-d01d15d0c245 req-9974ea2f-1144-44ce-aef2-3b9305e76905 service nova] Releasing lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e24cd202-a8b8-4ce8-a127-01d614b0a0a5 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.620s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:27 user nova-compute[76815]: INFO nova.compute.manager [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Detaching volume 3b133282-cd5a-41df-9370-0c0b0c4951aa
Nov 14 22:19:27 user nova-compute[76815]: INFO nova.virt.block_device [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Attempting to driver detach volume 3b133282-cd5a-41df-9370-0c0b0c4951aa from mountpoint /dev/vdb
Nov 14 22:19:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Attempting to detach device vdb from instance bc3a520b-21e4-463e-a39d-a397c3e6b811 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:19:27 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:19:27 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:19:27 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:19:27 user nova-compute[76815]:   <serial>3b133282-cd5a-41df-9370-0c0b0c4951aa</serial>
Nov 14 22:19:27 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 22:19:27 user nova-compute[76815]: </disk>
Nov 14 22:19:27 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:19:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully detached device vdb from instance bc3a520b-21e4-463e-a39d-a397c3e6b811 from the persistent domain config.
Nov 14 22:19:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc3a520b-21e4-463e-a39d-a397c3e6b811 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:19:27 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:19:27 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:19:27 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:19:27 user nova-compute[76815]:   <serial>3b133282-cd5a-41df-9370-0c0b0c4951aa</serial>
Nov 14 22:19:27 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 22:19:27 user nova-compute[76815]: </disk>
Nov 14 22:19:27 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc3a520b-21e4-463e-a39d-a397c3e6b811 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG nova.objects.instance [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lazy-loading 'pci_requests' on Instance uuid 648e61c3-1925-4e22-8dc7-3bd8c0558487 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG nova.objects.instance [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lazy-loading 'numa_topology' on Instance uuid 648e61c3-1925-4e22-8dc7-3bd8c0558487 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:19:27 user nova-compute[76815]: INFO nova.compute.claims [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Claim successful on node user
Nov 14 22:19:28 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:19:28 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:19:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:28 user nova-compute[76815]: INFO nova.network.neutron [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating port cb3956f2-83bd-4ad2-a094-05a0c983a4a2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 22:19:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquired lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-b77122d5-a52c-441e-a67d-1f4136e11c57 req-7c3f4beb-d57f-44da-8eee-a5be9284da0c service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-changed-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-b77122d5-a52c-441e-a67d-1f4136e11c57 req-7c3f4beb-d57f-44da-8eee-a5be9284da0c service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Refreshing instance network info cache due to event network-changed-cb3956f2-83bd-4ad2-a094-05a0c983a4a2. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b77122d5-a52c-441e-a67d-1f4136e11c57 req-7c3f4beb-d57f-44da-8eee-a5be9284da0c service nova] Acquiring lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.network.neutron [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating instance_info_cache with network_info: [{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Releasing lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:19:29 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Creating image(s)
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Ensure instance console log exists: /opt/stack/data/nova/instances/648e61c3-1925-4e22-8dc7-3bd8c0558487/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Start _get_guest_xml network_info=[{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avQAsjSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '648e61c3-1925-4e22-8dc7-3bd8c0558487', 'attached_at': '', 'detached_at': '', 'volume_id': 'b98fed93-15d7-4f20-8532-1b940ef1834d', 'serial': 'b98fed93-15d7-4f20-8532-1b940ef1834d'}, 'attachment_id': '99e13134-5c3c-4da8-a3a7-334410193c06', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b77122d5-a52c-441e-a67d-1f4136e11c57 req-7c3f4beb-d57f-44da-8eee-a5be9284da0c service nova] Acquired lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-b77122d5-a52c-441e-a67d-1f4136e11c57 req-7c3f4beb-d57f-44da-8eee-a5be9284da0c service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Refreshing network info cache for port cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:19:29 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:19:29 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.objects.instance [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lazy-loading 'vcpu_model' on Instance uuid 648e61c3-1925-4e22-8dc7-3bd8c0558487 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.objects.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Object Instance<648e61c3-1925-4e22-8dc7-3bd8c0558487> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avQAsjSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:19:29 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:19:29 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:19:29 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbbaddd-2fe5-4b82-804c-befcf01ab9e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:19:29 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d042330-1f4a-4aba-af47-0b5451a16bcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d] added
Nov 14 22:19:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4b4464-bffa-4e4c-acef-3f49b222687d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e87000-32e0-4133-9a79-70d8051d2353]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avQAsjSN {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avQAsjSN" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a47216-1afe-49d8-a2f7-a0c4c6b7fc9c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'avQAsjSN'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d7fc93-672a-475c-bb1d-893111c168ba]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d27a88-20d9-4001-8ad7-5c66efe1b83b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c4befe-8f63-476c-9436-7e9c9b89f7df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260]
Nov 14 22:19:29 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260] successful.
Nov 14 22:19:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e9b0f7-4a41-41be-b31f-0f7050b2a2a6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7024b5b9-7625-4203-84ef-d98d17cd9bff]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:19:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:29 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:19:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46df5252-ab31-4ed6-b49b-d3e584874fb1]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-b77122d5-a52c-441e-a67d-1f4136e11c57 req-7c3f4beb-d57f-44da-8eee-a5be9284da0c service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updated VIF entry in instance network info cache for port cb3956f2-83bd-4ad2-a094-05a0c983a4a2. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-b77122d5-a52c-441e-a67d-1f4136e11c57 req-7c3f4beb-d57f-44da-8eee-a5be9284da0c service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating instance_info_cache with network_info: [{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b77122d5-a52c-441e-a67d-1f4136e11c57 req-7c3f4beb-d57f-44da-8eee-a5be9284da0c service nova] Releasing lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avQAsjSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26265353430633265', 'path': '/dev/sde'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265353430633265', 'path': '/dev/sde'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1645877840',display_name='tempest-TestShelveInstance-server-1645877840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1645877840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-731084026',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='16d1e69321814403a08c9fe1a8b513c5',ramdisk_id='',reservation_id='r-cz2nxg7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1419119597',owner_user_name='tempest-TestShelveInstance-1419119597-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:19:23Z,user_data=None,user_id='b6735de275f141f5af89c22bc21adf95',uuid=648e61c3-1925-4e22-8dc7-3bd8c0558487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converting VIF {"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.objects.instance [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lazy-loading 'pci_devices' on Instance uuid 648e61c3-1925-4e22-8dc7-3bd8c0558487 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.objects.base [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Object Instance<648e61c3-1925-4e22-8dc7-3bd8c0558487> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:19:30 user nova-compute[76815]:   <uuid>648e61c3-1925-4e22-8dc7-3bd8c0558487</uuid>
Nov 14 22:19:30 user nova-compute[76815]:   <name>instance-00000018</name>
Nov 14 22:19:30 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:19:30 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:19:30 user nova-compute[76815]:   <metadata>
Nov 14 22:19:30 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:19:30 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:19:30 user nova-compute[76815]:       <nova:name>tempest-TestShelveInstance-server-1645877840</nova:name>
Nov 14 22:19:30 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:19:29</nova:creationTime>
Nov 14 22:19:30 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:19:30 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:19:30 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:19:30 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:19:30 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:19:30 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:19:30 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:19:30 user nova-compute[76815]:       <nova:owner>
Nov 14 22:19:30 user nova-compute[76815]:         <nova:user uuid="b6735de275f141f5af89c22bc21adf95">tempest-TestShelveInstance-1419119597-project-member</nova:user>
Nov 14 22:19:30 user nova-compute[76815]:         <nova:project uuid="16d1e69321814403a08c9fe1a8b513c5">tempest-TestShelveInstance-1419119597</nova:project>
Nov 14 22:19:30 user nova-compute[76815]:       </nova:owner>
Nov 14 22:19:30 user nova-compute[76815]:       <nova:ports>
Nov 14 22:19:30 user nova-compute[76815]:         <nova:port uuid="cb3956f2-83bd-4ad2-a094-05a0c983a4a2">
Nov 14 22:19:30 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 22:19:30 user nova-compute[76815]:         </nova:port>
Nov 14 22:19:30 user nova-compute[76815]:       </nova:ports>
Nov 14 22:19:30 user nova-compute[76815]:     </nova:instance>
Nov 14 22:19:30 user nova-compute[76815]:   </metadata>
Nov 14 22:19:30 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:19:30 user nova-compute[76815]:     <system>
Nov 14 22:19:30 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:19:30 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:19:30 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:19:30 user nova-compute[76815]:       <entry name="serial">648e61c3-1925-4e22-8dc7-3bd8c0558487</entry>
Nov 14 22:19:30 user nova-compute[76815]:       <entry name="uuid">648e61c3-1925-4e22-8dc7-3bd8c0558487</entry>
Nov 14 22:19:30 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:19:30 user nova-compute[76815]:     </system>
Nov 14 22:19:30 user nova-compute[76815]:   </sysinfo>
Nov 14 22:19:30 user nova-compute[76815]:   <os>
Nov 14 22:19:30 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:19:30 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:19:30 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:19:30 user nova-compute[76815]:   </os>
Nov 14 22:19:30 user nova-compute[76815]:   <features>
Nov 14 22:19:30 user nova-compute[76815]:     <acpi/>
Nov 14 22:19:30 user nova-compute[76815]:     <apic/>
Nov 14 22:19:30 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:19:30 user nova-compute[76815]:   </features>
Nov 14 22:19:30 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:19:30 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:19:30 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:19:30 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:19:30 user nova-compute[76815]:   </clock>
Nov 14 22:19:30 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:19:30 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:19:30 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:19:30 user nova-compute[76815]:   </cpu>
Nov 14 22:19:30 user nova-compute[76815]:   <devices>
Nov 14 22:19:30 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:19:30 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:19:30 user nova-compute[76815]:       <source dev="/dev/sde"/>
Nov 14 22:19:30 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:19:30 user nova-compute[76815]:       <serial>b98fed93-15d7-4f20-8532-1b940ef1834d</serial>
Nov 14 22:19:30 user nova-compute[76815]:     </disk>
Nov 14 22:19:30 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:19:30 user nova-compute[76815]:       <mac address="fa:16:3e:ac:55:32"/>
Nov 14 22:19:30 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:19:30 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:19:30 user nova-compute[76815]:       <target dev="tapcb3956f2-83"/>
Nov 14 22:19:30 user nova-compute[76815]:     </interface>
Nov 14 22:19:30 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:19:30 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/648e61c3-1925-4e22-8dc7-3bd8c0558487/console.log" append="off"/>
Nov 14 22:19:30 user nova-compute[76815]:     </serial>
Nov 14 22:19:30 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:19:30 user nova-compute[76815]:     <video>
Nov 14 22:19:30 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:19:30 user nova-compute[76815]:     </video>
Nov 14 22:19:30 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:19:30 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:19:30 user nova-compute[76815]:     </rng>
Nov 14 22:19:30 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:19:30 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:19:30 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:19:30 user nova-compute[76815]:     </memballoon>
Nov 14 22:19:30 user nova-compute[76815]:   </devices>
Nov 14 22:19:30 user nova-compute[76815]: </domain>
Nov 14 22:19:30 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1645877840',display_name='tempest-TestShelveInstance-server-1645877840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1645877840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-731084026',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='16d1e69321814403a08c9fe1a8b513c5',ramdisk_id='',reservation_id='r-cz2nxg7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1419119597',owner_user_name='tempest-TestShelveInstance-1419119597-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:19:23Z,user_data=None,user_id='b6735de275f141f5af89c22bc21adf95',uuid=648e61c3-1925-4e22-8dc7-3bd8c0558487,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converting VIF {"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG os_vif [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b40b6b06-923a-508a-a517-b85d5e35bd08', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb3956f2-83, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb3956f2-83, col_values=(('qos', UUID('09753cda-0d25-418b-ba00-11dd2c041315')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb3956f2-83, col_values=(('external_ids', {'iface-id': 'cb3956f2-83bd-4ad2-a094-05a0c983a4a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:55:32', 'vm-uuid': '648e61c3-1925-4e22-8dc7-3bd8c0558487'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:30 user nova-compute[76815]: INFO os_vif [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83')
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:19:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] No VIF found with MAC fa:16:3e:ac:55:32, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:19:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-0759aeac-1a91-4c1a-bbdb-de91200e423e req-dd0012a9-b7f8-49b6-afd7-1a7592486d57 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0759aeac-1a91-4c1a-bbdb-de91200e423e req-dd0012a9-b7f8-49b6-afd7-1a7592486d57 service nova] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0759aeac-1a91-4c1a-bbdb-de91200e423e req-dd0012a9-b7f8-49b6-afd7-1a7592486d57 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0759aeac-1a91-4c1a-bbdb-de91200e423e req-dd0012a9-b7f8-49b6-afd7-1a7592486d57 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-0759aeac-1a91-4c1a-bbdb-de91200e423e req-dd0012a9-b7f8-49b6-afd7-1a7592486d57 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] No waiting events found dispatching network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:32 user nova-compute[76815]: WARNING nova.compute.manager [req-0759aeac-1a91-4c1a-bbdb-de91200e423e req-dd0012a9-b7f8-49b6-afd7-1a7592486d57 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received unexpected event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 22:19:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:19:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:19:34 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Instance spawned successfully.
Nov 14 22:19:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:19:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-45af4eb5-97a1-4088-b9da-925f17566068 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.426s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-b777427b-eb87-4616-9219-571b97437677 req-19f38ee0-7437-4ce0-b8e0-687617c74f3d service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b777427b-eb87-4616-9219-571b97437677 req-19f38ee0-7437-4ce0-b8e0-687617c74f3d service nova] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b777427b-eb87-4616-9219-571b97437677 req-19f38ee0-7437-4ce0-b8e0-687617c74f3d service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b777427b-eb87-4616-9219-571b97437677 req-19f38ee0-7437-4ce0-b8e0-687617c74f3d service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-b777427b-eb87-4616-9219-571b97437677 req-19f38ee0-7437-4ce0-b8e0-687617c74f3d service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] No waiting events found dispatching network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:34 user nova-compute[76815]: WARNING nova.compute.manager [req-b777427b-eb87-4616-9219-571b97437677 req-19f38ee0-7437-4ce0-b8e0-687617c74f3d service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received unexpected event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 for instance with vm_state active and task_state None.
Nov 14 22:19:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:19:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7902MB free_disk=24.993560791015625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0dc9077f-493b-44b7-bfde-1d448ae001fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance bc3a520b-21e4-463e-a39d-a397c3e6b811 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 59178f91-5932-41b5-9e21-7c2401be86ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 9e076b98-3f30-4a9a-aa97-330c748de261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ede2361a-e307-4f43-844c-b32b2ef6b4d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 648e61c3-1925-4e22-8dc7-3bd8c0558487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:19:39 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:19:40 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:19:40 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:19:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:19:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid a8bb243d-ad93-47ae-8fbe-b5845a29496d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updating instance_info_cache with network_info: [{"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:42 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:19:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:19:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bc3a520b-21e4-463e-a39d-a397c3e6b811 is timed out.
Nov 14 22:19:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully detached device vdb from instance bc3a520b-21e4-463e-a39d-a397c3e6b811 from the live domain config.
Nov 14 22:19:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnGOJNPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:19:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3fa3f0-550e-40c8-a92a-7b9eaa24de51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:19:47 user nova-compute[76815]: No targets found.
Nov 14 22:19:47 user nova-compute[76815]: iSNS:
Nov 14 22:19:47 user nova-compute[76815]: No targets found.
Nov 14 22:19:47 user nova-compute[76815]: STATIC:
Nov 14 22:19:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:19:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986
Nov 14 22:19:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa
Nov 14 22:19:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:19:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:19:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:47 user nova-compute[76815]: FIRMWARE:
Nov 14 22:19:47 user nova-compute[76815]: No targets found.
Nov 14 22:19:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:19:47 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:19:47 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7f5e99-cee0-40d8-a5af-1d40a81e8a3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[431f1145-a6fa-4dcd-93b3-bd2e06751da1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:47 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:47 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:47 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:47 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:19:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:47 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:47 user nova-compute[76815]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa (non-flash)
Nov 14 22:19:47 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:47 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:19:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a45b1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a19dc5a-72d5-4a49-8de1-0a2b2dcbd707]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d12bdfb-fc0e-4eb0-aff3-80a063f2ea08]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d615010-3baf-43b8-a4bf-f2e8b9b9609f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f08c2cc-80fb-4fbd-934e-7035e937a999]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:19:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.126s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2010b089-e224-4379-bac9-629492b4c9e8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee8e2b1-e7bf-4bc4-ae28-45b57815bc79]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260]
Nov 14 22:19:48 user nova-compute[76815]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa, portal: 172.16.0.220,3260] successful.
Nov 14 22:19:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b133282-cd5a-41df-9370-0c0b0c4951aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a5739e-3fb4-4363-895f-ea27b36396da]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== disconnect_volume: return (429ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'flavor' on Instance uuid bc3a520b-21e4-463e-a39d-a397c3e6b811 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-875fa821-aea9-4410-bc5f-9b69439a9cc0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.840s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-b26da084-4c8a-4055-9a16-db546623839c req-45b6d5e8-2c2e-4bc1-895c-89efa9fa14cb service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received event network-changed-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-b26da084-4c8a-4055-9a16-db546623839c req-45b6d5e8-2c2e-4bc1-895c-89efa9fa14cb service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Refreshing instance network info cache due to event network-changed-f303ac60-d3ea-41ed-a423-7de3f10c886f. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:19:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b26da084-4c8a-4055-9a16-db546623839c req-45b6d5e8-2c2e-4bc1-895c-89efa9fa14cb service nova] Acquiring lock "refresh_cache-ede2361a-e307-4f43-844c-b32b2ef6b4d7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b26da084-4c8a-4055-9a16-db546623839c req-45b6d5e8-2c2e-4bc1-895c-89efa9fa14cb service nova] Acquired lock "refresh_cache-ede2361a-e307-4f43-844c-b32b2ef6b4d7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:54 user nova-compute[76815]: DEBUG nova.network.neutron [req-b26da084-4c8a-4055-9a16-db546623839c req-45b6d5e8-2c2e-4bc1-895c-89efa9fa14cb service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Refreshing network info cache for port f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:19:54 user nova-compute[76815]: DEBUG nova.network.neutron [req-b26da084-4c8a-4055-9a16-db546623839c req-45b6d5e8-2c2e-4bc1-895c-89efa9fa14cb service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Updated VIF entry in instance network info cache for port f303ac60-d3ea-41ed-a423-7de3f10c886f. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:19:54 user nova-compute[76815]: DEBUG nova.network.neutron [req-b26da084-4c8a-4055-9a16-db546623839c req-45b6d5e8-2c2e-4bc1-895c-89efa9fa14cb service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Updating instance_info_cache with network_info: [{"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b26da084-4c8a-4055-9a16-db546623839c req-45b6d5e8-2c2e-4bc1-895c-89efa9fa14cb service nova] Releasing lock "refresh_cache-ede2361a-e307-4f43-844c-b32b2ef6b4d7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:55 user nova-compute[76815]: INFO nova.compute.manager [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Terminating instance
Nov 14 22:19:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Instance destroyed successfully.
Nov 14 22:19:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'resources' on Instance uuid ede2361a-e307-4f43-844c-b32b2ef6b4d7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-662375112',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-662375112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-662375112',id=30,image_ref='50000c52-a791-4996-a81c-83a404023207',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJWLTcdyXamUcSRw9mjNKbROa4hEtpzhDkOqtpNXKG2APkoqnVbsI/uatw7WQ4LvnRuDUxZ/WE2ddxm+ZNiJ0QDLKTWd8WiXiFzaJAIw8inn3WA9eiyIPENqLvmDxjLMg==',key_name='tempest-keypair-63621170',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:18:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-d4fzicjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1821264948',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=ede2361a-e307-4f43-844c-b32b2ef6b4d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "address": "fa:16:3e:d5:04:94", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf303ac60-d3", "ovs_interfaceid": "f303ac60-d3ea-41ed-a423-7de3f10c886f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:04:94,bridge_name='br-int',has_traffic_filtering=True,id=f303ac60-d3ea-41ed-a423-7de3f10c886f,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf303ac60-d3') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_vif [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:04:94,bridge_name='br-int',has_traffic_filtering=True,id=f303ac60-d3ea-41ed-a423-7de3f10c886f,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf303ac60-d3') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf303ac60-d3, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4fffabfe-be96-46c7-9e98-8bfd6efdf371) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:55 user nova-compute[76815]: INFO os_vif [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:04:94,bridge_name='br-int',has_traffic_filtering=True,id=f303ac60-d3ea-41ed-a423-7de3f10c886f,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf303ac60-d3')
Nov 14 22:19:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMYhFAiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:19:55 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8574c391-a7d7-45d7-b54d-08de78108360]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:19:55 user nova-compute[76815]: No targets found.
Nov 14 22:19:55 user nova-compute[76815]: iSNS:
Nov 14 22:19:55 user nova-compute[76815]: No targets found.
Nov 14 22:19:55 user nova-compute[76815]: STATIC:
Nov 14 22:19:55 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:19:55 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:55 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:55 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986
Nov 14 22:19:55 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:55 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:55 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:19:55 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:55 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:55 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:19:55 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:19:55 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:19:55 user nova-compute[76815]: FIRMWARE:
Nov 14 22:19:55 user nova-compute[76815]: No targets found.
Nov 14 22:19:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:19:55 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:19:55 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de4c00d-a7ca-4d71-bb6e-f5cd704270e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ddba5-785b-45f1-a41e-c23e999a4847]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:55 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:55 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:55 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:19:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:19:55 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:19:55 user nova-compute[76815]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 (non-flash)
Nov 14 22:19:55 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:19:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8563a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986'): ({'sdf'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Removing single pathed devices sdf {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f7afd0-e774-4232-84b8-412e65c61a8d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9763bf-ac85-44bc-bbdb-3046edab6aca]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flushing IO for device /dev/sdf {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c4056d-0e4c-4d26-baff-9f8201c179e9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[16955e68-9d2b-490e-9b0f-e6bd12762444]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e8d057-2c49-495e-bbf4-9439ac312e43]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[504728a7-20a9-4411-852c-e3d4ccb14410]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986, portal: 172.16.0.220,3260]
Nov 14 22:19:56 user nova-compute[76815]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986, portal: 172.16.0.220,3260] successful.
Nov 14 22:19:56 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[843f9cbb-0ff6-4a98-8f5d-81a88334fa34]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== disconnect_volume: return (326ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:19:56 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Deleting instance files /opt/stack/data/nova/instances/ede2361a-e307-4f43-844c-b32b2ef6b4d7_del
Nov 14 22:19:56 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Deletion of /opt/stack/data/nova/instances/ede2361a-e307-4f43-844c-b32b2ef6b4d7_del complete
Nov 14 22:19:56 user nova-compute[76815]: INFO nova.compute.manager [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received event network-vif-unplugged-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] Acquiring lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] No waiting events found dispatching network-vif-unplugged-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received event network-vif-unplugged-f303ac60-d3ea-41ed-a423-7de3f10c886f for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received event network-vif-plugged-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] Acquiring lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] No waiting events found dispatching network-vif-plugged-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:56 user nova-compute[76815]: WARNING nova.compute.manager [req-bb9ac7ff-4ff8-48c7-845b-1ceb83e2a9af req-b22cb53a-422e-49b9-a2b0-717aefefb744 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received unexpected event network-vif-plugged-f303ac60-d3ea-41ed-a423-7de3f10c886f for instance with vm_state active and task_state deleting.
Nov 14 22:19:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:57 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Took 0.73 seconds to deallocate network for instance.
Nov 14 22:19:57 user nova-compute[76815]: INFO nova.compute.manager [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 22:19:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Deleting volume: 4f4e2e23-a1b4-4864-b0a2-b7f15a10d986 {{(pid=76815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-bc63e50c-b19d-4288-a1ed-6db99cddea99 req-9b503175-637f-4e35-8a71-50d5170f073b service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received event network-changed-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-bc63e50c-b19d-4288-a1ed-6db99cddea99 req-9b503175-637f-4e35-8a71-50d5170f073b service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Refreshing instance network info cache due to event network-changed-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bc63e50c-b19d-4288-a1ed-6db99cddea99 req-9b503175-637f-4e35-8a71-50d5170f073b service nova] Acquiring lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bc63e50c-b19d-4288-a1ed-6db99cddea99 req-9b503175-637f-4e35-8a71-50d5170f073b service nova] Acquired lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG nova.network.neutron [req-bc63e50c-b19d-4288-a1ed-6db99cddea99 req-9b503175-637f-4e35-8a71-50d5170f073b service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Refreshing network info cache for port 6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:57 user nova-compute[76815]: INFO nova.compute.manager [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Terminating instance
Nov 14 22:19:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:58 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Deleted allocations for instance ede2361a-e307-4f43-844c-b32b2ef6b4d7
Nov 14 22:19:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bf1af068-452f-4a05-9dfc-939bda0ba29d tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "ede2361a-e307-4f43-844c-b32b2ef6b4d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.459s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.network.neutron [req-bc63e50c-b19d-4288-a1ed-6db99cddea99 req-9b503175-637f-4e35-8a71-50d5170f073b service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updated VIF entry in instance network info cache for port 6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.network.neutron [req-bc63e50c-b19d-4288-a1ed-6db99cddea99 req-9b503175-637f-4e35-8a71-50d5170f073b service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updating instance_info_cache with network_info: [{"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bc63e50c-b19d-4288-a1ed-6db99cddea99 req-9b503175-637f-4e35-8a71-50d5170f073b service nova] Releasing lock "refresh_cache-0dc9077f-493b-44b7-bfde-1d448ae001fd" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-597fc7f9-2316-46cc-b7b5-c2e4c0e9a844 req-484ee3a5-f2d6-453a-909f-1ff1c32d4582 service nova] [instance: ede2361a-e307-4f43-844c-b32b2ef6b4d7] Received event network-vif-deleted-f303ac60-d3ea-41ed-a423-7de3f10c886f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-597fc7f9-2316-46cc-b7b5-c2e4c0e9a844 req-484ee3a5-f2d6-453a-909f-1ff1c32d4582 service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received event network-vif-unplugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-597fc7f9-2316-46cc-b7b5-c2e4c0e9a844 req-484ee3a5-f2d6-453a-909f-1ff1c32d4582 service nova] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-597fc7f9-2316-46cc-b7b5-c2e4c0e9a844 req-484ee3a5-f2d6-453a-909f-1ff1c32d4582 service nova] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-597fc7f9-2316-46cc-b7b5-c2e4c0e9a844 req-484ee3a5-f2d6-453a-909f-1ff1c32d4582 service nova] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-597fc7f9-2316-46cc-b7b5-c2e4c0e9a844 req-484ee3a5-f2d6-453a-909f-1ff1c32d4582 service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] No waiting events found dispatching network-vif-unplugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-597fc7f9-2316-46cc-b7b5-c2e4c0e9a844 req-484ee3a5-f2d6-453a-909f-1ff1c32d4582 service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received event network-vif-unplugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:19:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Instance destroyed successfully.
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lazy-loading 'resources' on Instance uuid 0dc9077f-493b-44b7-bfde-1d448ae001fd {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:13:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1673265283',display_name='tempest-TestStampPattern-server-1673265283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1673265283',id=18,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIz7adDgP7X73sp1hk5zQagIy7YAy0++VDgbZ8Zj9KPV4CgTwfipeuF7/mA4SwM5VVflsdyyENIt6u4cntTENc7drNh/bLAHBUCOpidpzrADFvxpLgpN2YTtL81gY4jTQ==',key_name='tempest-TestStampPattern-197761174',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:13:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='202f1749bf684dbfa082a1bf1eee2b2e',ramdisk_id='',reservation_id='r-x7rqdkvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1059321344',owner_user_name='tempest-TestStampPattern-1059321344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:16:09Z,user_data=None,user_id='6a7d3c7ad83543cbafc5e5ebcc2e7a01',uuid=0dc9077f-493b-44b7-bfde-1d448ae001fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converting VIF {"id": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "address": "fa:16:3e:31:e3:01", "network": {"id": "a3928408-0ce4-48bb-87b3-4a6d13b17b4f", "bridge": "br-int", "label": "tempest-TestStampPattern-484385301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "202f1749bf684dbfa082a1bf1eee2b2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdc63ab-ea", "ovs_interfaceid": "6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:e3:01,bridge_name='br-int',has_traffic_filtering=True,id=6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdc63ab-ea') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG os_vif [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:e3:01,bridge_name='br-int',has_traffic_filtering=True,id=6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdc63ab-ea') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fdc63ab-ea, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfd2a68f-d3b0-4003-8b50-60fdd7f37fc2) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:19:58 user nova-compute[76815]: INFO os_vif [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:e3:01,bridge_name='br-int',has_traffic_filtering=True,id=6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325,network=Network(a3928408-0ce4-48bb-87b3-4a6d13b17b4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdc63ab-ea')
Nov 14 22:19:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Deleting instance files /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd_del
Nov 14 22:19:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Deletion of /opt/stack/data/nova/instances/0dc9077f-493b-44b7-bfde-1d448ae001fd_del complete
Nov 14 22:19:58 user nova-compute[76815]: INFO nova.compute.manager [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 22:19:58 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:19:58 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:19:59 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:19:59 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Took 0.86 seconds to deallocate network for instance.
Nov 14 22:19:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:19:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:19:59 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:20:00 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:20:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:00 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Deleted allocations for instance 0dc9077f-493b-44b7-bfde-1d448ae001fd
Nov 14 22:20:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4bd932b-26c8-4a08-8e12-dbaeb5993c72 tempest-TestStampPattern-1059321344 tempest-TestStampPattern-1059321344-project-member] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.246s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3f82170-f6f9-439b-912f-448a9a5555c7 req-4d6142c2-6063-41ee-bb3f-b30832a64755 service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received event network-vif-plugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3f82170-f6f9-439b-912f-448a9a5555c7 req-4d6142c2-6063-41ee-bb3f-b30832a64755 service nova] Acquiring lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3f82170-f6f9-439b-912f-448a9a5555c7 req-4d6142c2-6063-41ee-bb3f-b30832a64755 service nova] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3f82170-f6f9-439b-912f-448a9a5555c7 req-4d6142c2-6063-41ee-bb3f-b30832a64755 service nova] Lock "0dc9077f-493b-44b7-bfde-1d448ae001fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3f82170-f6f9-439b-912f-448a9a5555c7 req-4d6142c2-6063-41ee-bb3f-b30832a64755 service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] No waiting events found dispatching network-vif-plugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:20:00 user nova-compute[76815]: WARNING nova.compute.manager [req-e3f82170-f6f9-439b-912f-448a9a5555c7 req-4d6142c2-6063-41ee-bb3f-b30832a64755 service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received unexpected event network-vif-plugged-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 for instance with vm_state deleted and task_state None.
Nov 14 22:20:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3f82170-f6f9-439b-912f-448a9a5555c7 req-4d6142c2-6063-41ee-bb3f-b30832a64755 service nova] [instance: 0dc9077f-493b-44b7-bfde-1d448ae001fd] Received event network-vif-deleted-6fdc63ab-ea2a-44fb-9d8c-4f156b9a3325 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:20:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:20:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:20:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:20:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:17 user nova-compute[76815]: INFO nova.compute.manager [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Terminating instance
Nov 14 22:20:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-10e98654-ee98-4463-8051-426c10478d42 req-bbb97ab4-6f35-4d0b-aa91-7ce6e83caf8b service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-unplugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-10e98654-ee98-4463-8051-426c10478d42 req-bbb97ab4-6f35-4d0b-aa91-7ce6e83caf8b service nova] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-10e98654-ee98-4463-8051-426c10478d42 req-bbb97ab4-6f35-4d0b-aa91-7ce6e83caf8b service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-10e98654-ee98-4463-8051-426c10478d42 req-bbb97ab4-6f35-4d0b-aa91-7ce6e83caf8b service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-10e98654-ee98-4463-8051-426c10478d42 req-bbb97ab4-6f35-4d0b-aa91-7ce6e83caf8b service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] No waiting events found dispatching network-vif-unplugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:20:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-10e98654-ee98-4463-8051-426c10478d42 req-bbb97ab4-6f35-4d0b-aa91-7ce6e83caf8b service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-unplugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:20:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Instance destroyed successfully.
Nov 14 22:20:18 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'resources' on Instance uuid bc3a520b-21e4-463e-a39d-a397c3e6b811 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:14:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-154093738',display_name='tempest-ServerActionsTestOtherA-server-1563321332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-154093738',id=22,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnVf2EWXLMs2o+nLDUXPoKm0hgmUOTA1zAb/3U4CPDjSB7YxhNV5mJeWkrA2EmLxBCKN0nz61aoShmbeUlFgdVdFbCYX1l1oQTWzXwjLMEqD/lfWCuGPtA9s6dLyaaG9A==',key_name='tempest-keypair-1456019355',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:16:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-7f3rq2il',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:16:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=bc3a520b-21e4-463e-a39d-a397c3e6b811,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "address": "fa:16:3e:ec:14:23", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ce994cd-fb", "ovs_interfaceid": "0ce994cd-fb33-42e5-80c7-0878f2e9890a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG os_vif [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ce994cd-fb, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ad85862-7a3e-4ced-8bcf-fcc09f0486e1) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:20:18 user nova-compute[76815]: INFO os_vif [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:14:23,bridge_name='br-int',has_traffic_filtering=True,id=0ce994cd-fb33-42e5-80c7-0878f2e9890a,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ce994cd-fb')
Nov 14 22:20:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Deleting instance files /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811_del
Nov 14 22:20:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Deletion of /opt/stack/data/nova/instances/bc3a520b-21e4-463e-a39d-a397c3e6b811_del complete
Nov 14 22:20:18 user nova-compute[76815]: INFO nova.compute.manager [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 22:20:18 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:20:18 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:20:18 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Took 0.63 seconds to deallocate network for instance.
Nov 14 22:20:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:19 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:20:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:20:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:19 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Deleted allocations for instance bc3a520b-21e4-463e-a39d-a397c3e6b811
Nov 14 22:20:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e646cbdf-173b-404d-8e67-c7d0145ec28b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-d29e313b-9ad5-4de6-a3ea-50a983a4b2d8 req-e1b75360-0693-4713-8943-e623079192a8 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d29e313b-9ad5-4de6-a3ea-50a983a4b2d8 req-e1b75360-0693-4713-8943-e623079192a8 service nova] Acquiring lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d29e313b-9ad5-4de6-a3ea-50a983a4b2d8 req-e1b75360-0693-4713-8943-e623079192a8 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d29e313b-9ad5-4de6-a3ea-50a983a4b2d8 req-e1b75360-0693-4713-8943-e623079192a8 service nova] Lock "bc3a520b-21e4-463e-a39d-a397c3e6b811-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-d29e313b-9ad5-4de6-a3ea-50a983a4b2d8 req-e1b75360-0693-4713-8943-e623079192a8 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] No waiting events found dispatching network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:20:19 user nova-compute[76815]: WARNING nova.compute.manager [req-d29e313b-9ad5-4de6-a3ea-50a983a4b2d8 req-e1b75360-0693-4713-8943-e623079192a8 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received unexpected event network-vif-plugged-0ce994cd-fb33-42e5-80c7-0878f2e9890a for instance with vm_state deleted and task_state None.
Nov 14 22:20:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-d29e313b-9ad5-4de6-a3ea-50a983a4b2d8 req-e1b75360-0693-4713-8943-e623079192a8 service nova] [instance: bc3a520b-21e4-463e-a39d-a397c3e6b811] Received event network-vif-deleted-0ce994cd-fb33-42e5-80c7-0878f2e9890a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:20:38 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:20:38 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8237MB free_disk=25.14437484741211GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 59178f91-5932-41b5-9e21-7c2401be86ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 9e076b98-3f30-4a9a-aa97-330c748de261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 648e61c3-1925-4e22-8dc7-3bd8c0558487 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:20:38 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:20:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:20:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:20:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:20:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:20:40 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:20:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:20:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:20:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:20:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:20:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:20:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 065c90e1-2099-4446-a998-de681bedf500] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:20:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updating instance_info_cache with network_info: [{"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:20:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:20:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:20:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "59178f91-5932-41b5-9e21-7c2401be86ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:46 user nova-compute[76815]: INFO nova.compute.manager [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Terminating instance
Nov 14 22:20:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-756d6e55-8087-44ec-99e8-915211712083 req-526f9b7b-be46-4505-9446-b3468edcd4cd service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-unplugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-756d6e55-8087-44ec-99e8-915211712083 req-526f9b7b-be46-4505-9446-b3468edcd4cd service nova] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-756d6e55-8087-44ec-99e8-915211712083 req-526f9b7b-be46-4505-9446-b3468edcd4cd service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-756d6e55-8087-44ec-99e8-915211712083 req-526f9b7b-be46-4505-9446-b3468edcd4cd service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-756d6e55-8087-44ec-99e8-915211712083 req-526f9b7b-be46-4505-9446-b3468edcd4cd service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] No waiting events found dispatching network-vif-unplugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:20:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-756d6e55-8087-44ec-99e8-915211712083 req-526f9b7b-be46-4505-9446-b3468edcd4cd service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-unplugged-13aded5c-717f-4931-8072-8e000de745b8 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Instance destroyed successfully.
Nov 14 22:20:47 user nova-compute[76815]: DEBUG nova.objects.instance [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'resources' on Instance uuid 59178f91-5932-41b5-9e21-7c2401be86ac {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1451091158',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1451091158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1451091158',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBfuOBp83xFoozD4dLOfo8dQ40taUPwJ2s0+hzOwisN11fg8QrfdP9UFvZHdNYzzP7RNm0hvHlYFImCsCDyJfsapGaAzIne3pM1+Dd+cHkZESgJwjCK7M7vYMow6EM2aA==',key_name='tempest-keypair-1731125153',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-mu4kpiua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=59178f91-5932-41b5-9e21-7c2401be86ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "13aded5c-717f-4931-8072-8e000de745b8", "address": "fa:16:3e:d6:c4:3a", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13aded5c-71", "ovs_interfaceid": "13aded5c-717f-4931-8072-8e000de745b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:c4:3a,bridge_name='br-int',has_traffic_filtering=True,id=13aded5c-717f-4931-8072-8e000de745b8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13aded5c-71') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_vif [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:c4:3a,bridge_name='br-int',has_traffic_filtering=True,id=13aded5c-717f-4931-8072-8e000de745b8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13aded5c-71') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13aded5c-71, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a634e59-b1fe-4098-be0b-0ef7c7d0015a) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: INFO os_vif [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:c4:3a,bridge_name='br-int',has_traffic_filtering=True,id=13aded5c-717f-4931-8072-8e000de745b8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13aded5c-71')
Nov 14 22:20:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQnjmcxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:20:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f43b3-4354-425b-b2da-fbfa78416563]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:20:47 user nova-compute[76815]: No targets found.
Nov 14 22:20:47 user nova-compute[76815]: iSNS:
Nov 14 22:20:47 user nova-compute[76815]: No targets found.
Nov 14 22:20:47 user nova-compute[76815]: STATIC:
Nov 14 22:20:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21
Nov 14 22:20:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:20:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:20:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:20:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:20:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:20:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:20:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:20:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:20:47 user nova-compute[76815]: FIRMWARE:
Nov 14 22:20:47 user nova-compute[76815]: No targets found.
Nov 14 22:20:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:20:47 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:20:47 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b97c27-6094-4e1e-b98d-a8fb30ef9ec9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[105edc25-aa18-41c8-acdb-5308b9d7bf9b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:20:47 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:20:47 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:20:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:20:47 user nova-compute[76815]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 (non-flash)
Nov 14 22:20:47 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:20:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74d91ed900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b8fe0c-f68f-4bcb-a75c-42eb84d97646]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd29b234-7ce6-4610-8dff-1ff9065987be]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24675b1-c8fa-45b0-a2cb-8b04ac322385]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[455b5ec0-1a70-4ffd-a32f-8b71f56c39e8]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb254fd00-3b05e0c8a20ab3bb', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b254fd00', '/dev/disk/by-id/scsi-23362303565306338') {{(pid=86648) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c45f28-5936-47bd-9558-bd1caa6d841e]: (4, None) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae88dec5-b4f2-4f95-8c5a-6ea77eeac482]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa554f6-990e-45e7-8708-eeb4699f2511]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21, portal: 172.16.0.220,3260]
Nov 14 22:20:47 user nova-compute[76815]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21, portal: 172.16.0.220,3260] successful.
Nov 14 22:20:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8687df9-9d10-453e-b043-566948973a21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce37a77-5ba3-4ce9-846b-2f0eca7331d4]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== disconnect_volume: return (338ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:20:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Deleting instance files /opt/stack/data/nova/instances/59178f91-5932-41b5-9e21-7c2401be86ac_del
Nov 14 22:20:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Deletion of /opt/stack/data/nova/instances/59178f91-5932-41b5-9e21-7c2401be86ac_del complete
Nov 14 22:20:47 user nova-compute[76815]: INFO nova.compute.manager [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 22:20:47 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:20:48 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Took 0.94 seconds to deallocate network for instance.
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] No waiting events found dispatching network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:20:48 user nova-compute[76815]: WARNING nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received unexpected event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 for instance with vm_state active and task_state deleting.
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] No waiting events found dispatching network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:20:48 user nova-compute[76815]: WARNING nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received unexpected event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 for instance with vm_state active and task_state deleting.
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] No waiting events found dispatching network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:20:48 user nova-compute[76815]: WARNING nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received unexpected event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 for instance with vm_state active and task_state deleting.
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-unplugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] No waiting events found dispatching network-vif-unplugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-unplugged-13aded5c-717f-4931-8072-8e000de745b8 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Acquiring lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] Lock "59178f91-5932-41b5-9e21-7c2401be86ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] No waiting events found dispatching network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:20:48 user nova-compute[76815]: WARNING nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received unexpected event network-vif-plugged-13aded5c-717f-4931-8072-8e000de745b8 for instance with vm_state active and task_state deleting.
Nov 14 22:20:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-d64b14b6-3725-41a7-a73f-f613da531353 req-f8e85482-c210-4b9d-9b69-56e8f75922f9 service nova] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Received event network-vif-deleted-13aded5c-717f-4931-8072-8e000de745b8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:20:49 user nova-compute[76815]: INFO nova.compute.manager [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 22:20:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 59178f91-5932-41b5-9e21-7c2401be86ac] Deleting volume: e8687df9-9d10-453e-b043-566948973a21 {{(pid=76815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 22:20:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:49 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:20:49 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:20:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:49 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Deleted allocations for instance 59178f91-5932-41b5-9e21-7c2401be86ac
Nov 14 22:20:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a55aab56-1e9f-44ee-840b-19c50c43f74f tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "59178f91-5932-41b5-9e21-7c2401be86ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.343s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:20:58 user nova-compute[76815]: INFO nova.compute.claims [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Claim successful on node user
Nov 14 22:20:58 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:20:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:20:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:20:58 user nova-compute[76815]: DEBUG nova.policy [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6ef0744ff3b459b9e32404ec12bbe55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327b9fb17cb74bb0a56380b0d084cec3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:20:59 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Creating image(s)
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "/opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "/opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk 1073741824" returned: 0 in 0.048s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Successfully created port: 7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Cannot resize image /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Ensure instance console log exists: /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:20:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Successfully updated port: 7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "refresh_cache-f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquired lock "refresh_cache-f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-38db0c86-a0b6-4b59-be08-59104e4fccb0 req-7226db54-6266-4d1a-a4c4-7f861b44bffa service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received event network-changed-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-38db0c86-a0b6-4b59-be08-59104e4fccb0 req-7226db54-6266-4d1a-a4c4-7f861b44bffa service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Refreshing instance network info cache due to event network-changed-7e4c4ca9-50d1-4328-90e4-4b3911e1407e. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-38db0c86-a0b6-4b59-be08-59104e4fccb0 req-7226db54-6266-4d1a-a4c4-7f861b44bffa service nova] Acquiring lock "refresh_cache-f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Updating instance_info_cache with network_info: [{"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Releasing lock "refresh_cache-f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Instance network_info: |[{"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-38db0c86-a0b6-4b59-be08-59104e4fccb0 req-7226db54-6266-4d1a-a4c4-7f861b44bffa service nova] Acquired lock "refresh_cache-f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.neutron [req-38db0c86-a0b6-4b59-be08-59104e4fccb0 req-7226db54-6266-4d1a-a4c4-7f861b44bffa service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Refreshing network info cache for port 7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Start _get_guest_xml network_info=[{"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:21:00 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:00 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1750418106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1750418106',id=31,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-276xbjog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:20:59Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=f4f3b768-b95c-4dd3-807c-de5cdbc5ea84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8d:d3,bridge_name='br-int',has_traffic_filtering=True,id=7e4c4ca9-50d1-4328-90e4-4b3911e1407e,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c4ca9-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:21:00 user nova-compute[76815]:   <uuid>f4f3b768-b95c-4dd3-807c-de5cdbc5ea84</uuid>
Nov 14 22:21:00 user nova-compute[76815]:   <name>instance-0000001f</name>
Nov 14 22:21:00 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:21:00 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:21:00 user nova-compute[76815]:   <metadata>
Nov 14 22:21:00 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:21:00 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:21:00 user nova-compute[76815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1750418106</nova:name>
Nov 14 22:21:00 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:21:00</nova:creationTime>
Nov 14 22:21:00 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:21:00 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:21:00 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:21:00 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:21:00 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:21:00 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:21:00 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:21:00 user nova-compute[76815]:       <nova:owner>
Nov 14 22:21:00 user nova-compute[76815]:         <nova:user uuid="a6ef0744ff3b459b9e32404ec12bbe55">tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member</nova:user>
Nov 14 22:21:00 user nova-compute[76815]:         <nova:project uuid="327b9fb17cb74bb0a56380b0d084cec3">tempest-ServerBootFromVolumeStableRescueTest-890378304</nova:project>
Nov 14 22:21:00 user nova-compute[76815]:       </nova:owner>
Nov 14 22:21:00 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:21:00 user nova-compute[76815]:       <nova:ports>
Nov 14 22:21:00 user nova-compute[76815]:         <nova:port uuid="7e4c4ca9-50d1-4328-90e4-4b3911e1407e">
Nov 14 22:21:00 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 22:21:00 user nova-compute[76815]:         </nova:port>
Nov 14 22:21:00 user nova-compute[76815]:       </nova:ports>
Nov 14 22:21:00 user nova-compute[76815]:     </nova:instance>
Nov 14 22:21:00 user nova-compute[76815]:   </metadata>
Nov 14 22:21:00 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:21:00 user nova-compute[76815]:     <system>
Nov 14 22:21:00 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:21:00 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:21:00 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:21:00 user nova-compute[76815]:       <entry name="serial">f4f3b768-b95c-4dd3-807c-de5cdbc5ea84</entry>
Nov 14 22:21:00 user nova-compute[76815]:       <entry name="uuid">f4f3b768-b95c-4dd3-807c-de5cdbc5ea84</entry>
Nov 14 22:21:00 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:21:00 user nova-compute[76815]:     </system>
Nov 14 22:21:00 user nova-compute[76815]:   </sysinfo>
Nov 14 22:21:00 user nova-compute[76815]:   <os>
Nov 14 22:21:00 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:21:00 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:21:00 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:21:00 user nova-compute[76815]:   </os>
Nov 14 22:21:00 user nova-compute[76815]:   <features>
Nov 14 22:21:00 user nova-compute[76815]:     <acpi/>
Nov 14 22:21:00 user nova-compute[76815]:     <apic/>
Nov 14 22:21:00 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:21:00 user nova-compute[76815]:   </features>
Nov 14 22:21:00 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:21:00 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:21:00 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:21:00 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:21:00 user nova-compute[76815]:   </clock>
Nov 14 22:21:00 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:21:00 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:21:00 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:21:00 user nova-compute[76815]:   </cpu>
Nov 14 22:21:00 user nova-compute[76815]:   <devices>
Nov 14 22:21:00 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:21:00 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:21:00 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk"/>
Nov 14 22:21:00 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:21:00 user nova-compute[76815]:     </disk>
Nov 14 22:21:00 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:21:00 user nova-compute[76815]:       <mac address="fa:16:3e:8b:8d:d3"/>
Nov 14 22:21:00 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:21:00 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:21:00 user nova-compute[76815]:       <target dev="tap7e4c4ca9-50"/>
Nov 14 22:21:00 user nova-compute[76815]:     </interface>
Nov 14 22:21:00 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:21:00 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/console.log" append="off"/>
Nov 14 22:21:00 user nova-compute[76815]:     </serial>
Nov 14 22:21:00 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:21:00 user nova-compute[76815]:     <video>
Nov 14 22:21:00 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:21:00 user nova-compute[76815]:     </video>
Nov 14 22:21:00 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:21:00 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:21:00 user nova-compute[76815]:     </rng>
Nov 14 22:21:00 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:21:00 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:21:00 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:21:00 user nova-compute[76815]:     </memballoon>
Nov 14 22:21:00 user nova-compute[76815]:   </devices>
Nov 14 22:21:00 user nova-compute[76815]: </domain>
Nov 14 22:21:00 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1750418106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1750418106',id=31,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-276xbjog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:20:59Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=f4f3b768-b95c-4dd3-807c-de5cdbc5ea84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8d:d3,bridge_name='br-int',has_traffic_filtering=True,id=7e4c4ca9-50d1-4328-90e4-4b3911e1407e,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c4ca9-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG os_vif [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8d:d3,bridge_name='br-int',has_traffic_filtering=True,id=7e4c4ca9-50d1-4328-90e4-4b3911e1407e,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c4ca9-50') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '323f6d5c-23ef-5a50-82de-ec483fd7e929', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e4c4ca9-50, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e4c4ca9-50, col_values=(('qos', UUID('7be43da7-5343-468d-8666-37b090ca2f1b')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e4c4ca9-50, col_values=(('external_ids', {'iface-id': '7e4c4ca9-50d1-4328-90e4-4b3911e1407e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:8d:d3', 'vm-uuid': 'f4f3b768-b95c-4dd3-807c-de5cdbc5ea84'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:00 user nova-compute[76815]: INFO os_vif [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:8d:d3,bridge_name='br-int',has_traffic_filtering=True,id=7e4c4ca9-50d1-4328-90e4-4b3911e1407e,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c4ca9-50')
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No VIF found with MAC fa:16:3e:8b:8d:d3, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.neutron [req-38db0c86-a0b6-4b59-be08-59104e4fccb0 req-7226db54-6266-4d1a-a4c4-7f861b44bffa service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Updated VIF entry in instance network info cache for port 7e4c4ca9-50d1-4328-90e4-4b3911e1407e. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG nova.network.neutron [req-38db0c86-a0b6-4b59-be08-59104e4fccb0 req-7226db54-6266-4d1a-a4c4-7f861b44bffa service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Updating instance_info_cache with network_info: [{"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-38db0c86-a0b6-4b59-be08-59104e4fccb0 req-7226db54-6266-4d1a-a4c4-7f861b44bffa service nova] Releasing lock "refresh_cache-f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:21:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received event network-vif-plugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] Acquiring lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] No waiting events found dispatching network-vif-plugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:02 user nova-compute[76815]: WARNING nova.compute.manager [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received unexpected event network-vif-plugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e for instance with vm_state building and task_state spawning.
Nov 14 22:21:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received event network-vif-plugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] Acquiring lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] No waiting events found dispatching network-vif-plugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:02 user nova-compute[76815]: WARNING nova.compute.manager [req-d86378f6-f4b5-45a3-9c54-fc57577ac5cf req-a1b3ad2a-385e-454d-b373-2bec646b2acf service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received unexpected event network-vif-plugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e for instance with vm_state building and task_state spawning.
Nov 14 22:21:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:21:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:21:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Instance spawned successfully.
Nov 14 22:21:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:21:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:04 user nova-compute[76815]: INFO nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 14 22:21:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:21:04 user nova-compute[76815]: INFO nova.compute.manager [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Took 5.57 seconds to build instance.
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2f5388bd-7a16-42a5-9257-1ee2d7f44dda tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.669s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'flavor' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:04 user nova-compute[76815]: INFO nova.compute.manager [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Attaching volume 53ebb970-e00b-458d-a558-407d4eac3d44 to /dev/vdb
Nov 14 22:21:04 user nova-compute[76815]: DEBUG os_brick.utils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b6f1a2-046c-4678-9552-e9a2cf746347]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdea943d-6deb-4f41-ae17-3d59591f3d2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1dd179-53f4-4ed3-812f-fcd01bf1cc90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f803d30-d5c4-4128-8dcf-b9d9d43520b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:21:04 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:21:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65d9f73-2ff3-45b8-9203-0dc94659287e]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG os_brick.utils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:21:04 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating existing volume attachment record: c7ec294b-42e6-420e-a4ad-8f446a088cac {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:21:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKeZslLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:21:09 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:21:09 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:21:09 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[97311c00-5400-4710-a45a-f2fb18b5c321]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:21:09 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b272d95-b588-426f-968d-6473f1caddf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44] added
Nov 14 22:21:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[29239662-e524-4cc9-adc9-252c3c1f7145]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d7cd70-4af4-44d7-bc48-ae4899f2b6e6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKeZslLz {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKeZslLz" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcc8361-3670-4a24-88d5-228a340bf2ce]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cKeZslLz'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20277bd8-fd23-4116-98f3-15c3eabcacbc]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ffb59-5ea0-4047-9303-92faee21d632]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:09 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:21:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:09 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:21:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83174a7-25a3-421d-94cf-9bd33d4ed3b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44, portal: 172.16.0.220,3260]
Nov 14 22:21:09 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44, portal: 172.16.0.220,3260] successful.
Nov 14 22:21:09 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8e2272-b749-47a6-80e3-dc57ba9e2e7c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ee2344-a218-41e4-ba8a-e0aad9af919a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:10 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:21:10 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:10 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:10 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:21:10 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:10 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5234d0f-c64c-405a-83ea-11eb787e45bf]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKeZslLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:21:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26363373563643632', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363373563643632', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'flavor' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:21:11 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:21:11 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:21:11 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:21:11 user nova-compute[76815]:   <serial>53ebb970-e00b-458d-a558-407d4eac3d44</serial>
Nov 14 22:21:11 user nova-compute[76815]: </disk>
Nov 14 22:21:11 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:11 user nova-compute[76815]: INFO nova.compute.manager [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Unshelving
Nov 14 22:21:11 user nova-compute[76815]: INFO nova.virt.block_device [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Booting with volume 08922ff9-c725-420f-a531-09b0cc411951 at /dev/vdc
Nov 14 22:21:11 user nova-compute[76815]: DEBUG os_brick.utils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7c0d36-f09a-437d-9cf2-c865018ccd2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f136d04-8cfa-4138-a557-57d9825875d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3d0b94-d268-44a5-a772-b1d0fb22373d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ce30d-9784-4b74-86ec-8db43cde4624]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:21:11 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3298f11f-7b3a-43d7-9712-31d650937a0e]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG os_brick.utils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating existing volume attachment record: e90cfef4-dcd7-4263-bef4-58f72945ec53 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] No VIF found with MAC fa:16:3e:b6:d8:3f, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:21:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e365c3fa-82f1-408c-9e31-a408b309a4f2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.916s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:12 user nova-compute[76815]: INFO nova.compute.manager [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Rescuing
Nov 14 22:21:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:21:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquired lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:21:12 user nova-compute[76815]: DEBUG nova.network.neutron [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG nova.network.neutron [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating instance_info_cache with network_info: [{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Releasing lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-ebb09b7a-c439-4a97-8649-6ac33ee1e663 req-6172f9db-2ec1-4ca5-b355-e53504543cb2 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-unplugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ebb09b7a-c439-4a97-8649-6ac33ee1e663 req-6172f9db-2ec1-4ca5-b355-e53504543cb2 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ebb09b7a-c439-4a97-8649-6ac33ee1e663 req-6172f9db-2ec1-4ca5-b355-e53504543cb2 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ebb09b7a-c439-4a97-8649-6ac33ee1e663 req-6172f9db-2ec1-4ca5-b355-e53504543cb2 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-ebb09b7a-c439-4a97-8649-6ac33ee1e663 req-6172f9db-2ec1-4ca5-b355-e53504543cb2 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-unplugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:13 user nova-compute[76815]: WARNING nova.compute.manager [req-ebb09b7a-c439-4a97-8649-6ac33ee1e663 req-6172f9db-2ec1-4ca5-b355-e53504543cb2 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-unplugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state active and task_state rescuing.
Nov 14 22:21:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-1b49f743-4ee7-4a86-8d99-7e018ae72a43 req-03c5a74a-3ae6-4b39-bddb-9c86da39bf1d service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-changed-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-1b49f743-4ee7-4a86-8d99-7e018ae72a43 req-03c5a74a-3ae6-4b39-bddb-9c86da39bf1d service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Refreshing instance network info cache due to event network-changed-cb3956f2-83bd-4ad2-a094-05a0c983a4a2. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1b49f743-4ee7-4a86-8d99-7e018ae72a43 req-03c5a74a-3ae6-4b39-bddb-9c86da39bf1d service nova] Acquiring lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1b49f743-4ee7-4a86-8d99-7e018ae72a43 req-03c5a74a-3ae6-4b39-bddb-9c86da39bf1d service nova] Acquired lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG nova.network.neutron [req-1b49f743-4ee7-4a86-8d99-7e018ae72a43 req-03c5a74a-3ae6-4b39-bddb-9c86da39bf1d service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Refreshing network info cache for port cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:13 user nova-compute[76815]: INFO nova.compute.manager [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Terminating instance
Nov 14 22:21:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:21:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Instance destroyed successfully.
Nov 14 22:21:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Attempting a stable device rescue
Nov 14 22:21:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=76815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 22:21:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Instance directory exists: not creating {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 22:21:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Creating image(s)
Nov 14 22:21:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:14 user nova-compute[76815]: DEBUG nova.objects.instance [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "871b1b63fb21f63424a21841d5746388ad15eb5e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "871b1b63fb21f63424a21841d5746388ad15eb5e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Instance destroyed successfully.
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.objects.instance [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lazy-loading 'resources' on Instance uuid 648e61c3-1925-4e22-8dc7-3bd8c0558487 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1645877840',display_name='tempest-TestShelveInstance-server-1645877840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1645877840',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGRF3tZ5vukvGSPGaBbMdr+SLUVCiZZp9isJCMdELcILWbk/VZ5BcYT6poET5qWmdB/8GE0Jrkl3uFLur8pBS+W+3d5igXmBtRLCmzA+Z0WsC9rpzTa0JYgzqcTz+654Q==',key_name='tempest-TestShelveInstance-731084026',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:19:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16d1e69321814403a08c9fe1a8b513c5',ramdisk_id='',reservation_id='r-cz2nxg7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1419119597',owner_user_name='tempest-TestShelveInstance-1419119597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:19:34Z,user_data=None,user_id='b6735de275f141f5af89c22bc21adf95',uuid=648e61c3-1925-4e22-8dc7-3bd8c0558487,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converting VIF {"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_vif [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb3956f2-83, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09753cda-0d25-418b-ba00-11dd2c041315) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:15 user nova-compute[76815]: INFO os_vif [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:55:32,bridge_name='br-int',has_traffic_filtering=True,id=cb3956f2-83bd-4ad2-a094-05a0c983a4a2,network=Network(bb68aaef-4073-4f33-9a2a-b134a2e0822a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb3956f2-83')
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avQAsjSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:21:15 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4005245-1546-4788-a4d9-66a60a7a79e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:21:15 user nova-compute[76815]: No targets found.
Nov 14 22:21:15 user nova-compute[76815]: iSNS:
Nov 14 22:21:15 user nova-compute[76815]: No targets found.
Nov 14 22:21:15 user nova-compute[76815]: STATIC:
Nov 14 22:21:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:21:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:21:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:21:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d
Nov 14 22:21:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:21:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:21:15 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44
Nov 14 22:21:15 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:21:15 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:21:15 user nova-compute[76815]: FIRMWARE:
Nov 14 22:21:15 user nova-compute[76815]: No targets found.
Nov 14 22:21:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:21:15 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:21:15 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e.part --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.virt.images [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] 521d6b94-d4c0-4f56-8647-d543a78ca7e6 was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e.part /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed497c78-ae35-4657-b4da-ef63b5d86245]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:15 user nova-compute[76815]: WARNING nova.compute.manager [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state active and task_state rescuing.
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-unplugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] No waiting events found dispatching network-vif-unplugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-unplugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] Acquiring lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] No waiting events found dispatching network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:15 user nova-compute[76815]: WARNING nova.compute.manager [req-aa1d5fcc-4fa9-421a-8867-9e9224055bf5 req-86a2849f-c020-474a-9520-975fd01ef8d0 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received unexpected event network-vif-plugged-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 for instance with vm_state active and task_state deleting.
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d2beca-9394-4031-84a2-4fea93d7607a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:15 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:21:15 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:15 user nova-compute[76815]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d (non-flash)
Nov 14 22:21:15 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a45b2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d'): ({'sde'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Removing single pathed devices sde {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24d39d6-2cad-46a9-b798-cc988305b008]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[95691e5d-055f-4682-adf2-443ea7dceede]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Flushing IO for device /dev/sde {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-1b49f743-4ee7-4a86-8d99-7e018ae72a43 req-03c5a74a-3ae6-4b39-bddb-9c86da39bf1d service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updated VIF entry in instance network info cache for port cb3956f2-83bd-4ad2-a094-05a0c983a4a2. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-1b49f743-4ee7-4a86-8d99-7e018ae72a43 req-03c5a74a-3ae6-4b39-bddb-9c86da39bf1d service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating instance_info_cache with network_info: [{"id": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "address": "fa:16:3e:ac:55:32", "network": {"id": "bb68aaef-4073-4f33-9a2a-b134a2e0822a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1314174350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16d1e69321814403a08c9fe1a8b513c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb3956f2-83", "ovs_interfaceid": "cb3956f2-83bd-4ad2-a094-05a0c983a4a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f01b35-225f-4014-8931-fcdb5d96a860]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1b49f743-4ee7-4a86-8d99-7e018ae72a43 req-03c5a74a-3ae6-4b39-bddb-9c86da39bf1d service nova] Releasing lock "refresh_cache-648e61c3-1925-4e22-8dc7-3bd8c0558487" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.142s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfbdd17-8d80-401b-9724-16571ba24340]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d699eb9-504a-4008-8539-5d5a9ce9fdb2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[811265c8-8712-42fd-a5ed-8f616b66331e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260]
Nov 14 22:21:15 user nova-compute[76815]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d, portal: 172.16.0.220,3260] successful.
Nov 14 22:21:15 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b98fed93-15d7-4f20-8532-1b940ef1834d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6409fd-7ec3-4a51-83f9-56ba778b1c7f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.544s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] <== disconnect_volume: return (545ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:21:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:21:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Deleting instance files /opt/stack/data/nova/instances/648e61c3-1925-4e22-8dc7-3bd8c0558487_del
Nov 14 22:21:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Deletion of /opt/stack/data/nova/instances/648e61c3-1925-4e22-8dc7-3bd8c0558487_del complete
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e.part /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e.converted" returned: 0 in 0.646s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: INFO nova.compute.manager [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Took 2.30 seconds to destroy the instance on the hypervisor.
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "871b1b63fb21f63424a21841d5746388ad15eb5e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.343s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "871b1b63fb21f63424a21841d5746388ad15eb5e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "871b1b63fb21f63424a21841d5746388ad15eb5e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'pci_requests' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'numa_topology' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:21:16 user nova-compute[76815]: INFO nova.compute.claims [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Claim successful on node user
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e --force-share --output=json" returned: 0 in 0.192s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e,backing_fmt=raw /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e,backing_fmt=raw /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue" returned: 0 in 0.048s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "871b1b63fb21f63424a21841d5746388ad15eb5e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'migration_context' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Object Instance<9e076b98-3f30-4a9a-aa97-330c748de261> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Start _get_guest_xml network_info=[{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "vif_mac": "fa:16:3e:b6:d8:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '521d6b94-d4c0-4f56-8647-d543a78ca7e6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKeZslLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '9e076b98-3f30-4a9a-aa97-330c748de261', 'attached_at': '', 'detached_at': '', 'volume_id': '53ebb970-e00b-458d-a558-407d4eac3d44', 'serial': '53ebb970-e00b-458d-a558-407d4eac3d44'}, 'attachment_id': 'c7ec294b-42e6-420e-a4ad-8f446a088cac', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'resources' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Object Instance<9e076b98-3f30-4a9a-aa97-330c748de261> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Object Instance<9e076b98-3f30-4a9a-aa97-330c748de261> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:21:16 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:16 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Object Instance<9e076b98-3f30-4a9a-aa97-330c748de261> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKeZslLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:21:16 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:21:16 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:21:16 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be5728-70aa-4412-a6e2-79d91312d377]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cKeZslLz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 22:21:16 user nova-compute[76815]: node.name = iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44
Nov 14 22:21:16 user nova-compute[76815]: node.tpgt = -1
Nov 14 22:21:16 user nova-compute[76815]: node.startup = automatic
Nov 14 22:21:16 user nova-compute[76815]: node.leading_login = No
Nov 14 22:21:16 user nova-compute[76815]: iface.iscsi_ifacename = default
Nov 14 22:21:16 user nova-compute[76815]: iface.net_ifacename = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.ipaddress = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.prefix_len = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.hwaddress = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.transport_name = tcp
Nov 14 22:21:16 user nova-compute[76815]: iface.initiatorname = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.state = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.vlan_id = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.vlan_priority = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.vlan_state = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.iface_num = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.mtu = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.port = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.bootproto = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.subnet_mask = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.gateway = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.dhcp_alt_client_id = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.dhcp_dns = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.dhcp_learn_iqn = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.dhcp_vendor_id_state = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.dhcp_vendor_id = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.dhcp_slp_da = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.fragmentation = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.gratuitous_arp = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.incoming_forwarding = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.tos_state = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.tos = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.ttl = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.delayed_ack = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.tcp_nagle = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.tcp_wsf_state = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.tcp_wsf = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.tcp_timer_scale = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.tcp_timestamp = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.redirect = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.def_task_mgmt_timeout = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.header_digest = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.data_digest = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.immediate_data = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.initial_r2t = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.data_seq_inorder = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.data_pdu_inorder = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.erl = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.max_receive_data_len = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.first_burst_len = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.max_outstanding_r2t = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.max_burst_len = 0
Nov 14 22:21:16 user nova-compute[76815]: iface.chap_auth = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.bidi_chap = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.strict_login_compliance = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.discovery_auth = <empty>
Nov 14 22:21:16 user nova-compute[76815]: iface.discovery_logout = <empty>
Nov 14 22:21:16 user nova-compute[76815]: node.discovery_address = <empty>
Nov 14 22:21:16 user nova-compute[76815]: node.discovery_port = 0
Nov 14 22:21:16 user nova-compute[76815]: node.discovery_type = static
Nov 14 22:21:16 user nova-compute[76815]: node.session.initial_cmdsn = 0
Nov 14 22:21:16 user nova-compute[76815]: node.session.initial_login_retry_max = 8
Nov 14 22:21:16 user nova-compute[76815]: node.session.xmit_thread_priority = -20
Nov 14 22:21:16 user nova-compute[76815]: node.session.cmds_max = 128
Nov 14 22:21:16 user nova-compute[76815]: node.session.queue_depth = 32
Nov 14 22:21:16 user nova-compute[76815]: node.session.nr_sessions = 1
Nov 14 22:21:16 user nova-compute[76815]: node.session.auth.authmethod = CHAP
Nov 14 22:21:16 user nova-compute[76815]: node.session.auth.username = cKeZslLz
Nov 14 22:21:16 user nova-compute[76815]: node.session.auth.password = ***
Nov 14 22:21:16 user nova-compute[76815]: node.session.auth.username_in = <empty>
Nov 14 22:21:16 user nova-compute[76815]: node.session.auth.password_in = <empty>
Nov 14 22:21:16 user nova-compute[76815]: node.session.auth.chap_algs = MD5
Nov 14 22:21:16 user nova-compute[76815]: node.session.timeo.replacement_timeout = 120
Nov 14 22:21:16 user nova-compute[76815]: node.session.err_timeo.abort_timeout = 15
Nov 14 22:21:16 user nova-compute[76815]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 22:21:16 user nova-compute[76815]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 22:21:16 user nova-compute[76815]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.FastAbort = Yes
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.InitialR2T = No
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.ImmediateData = Yes
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.MaxConnections = 1
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 22:21:16 user nova-compute[76815]: node.session.iscsi.ERL = 0
Nov 14 22:21:16 user nova-compute[76815]: node.session.scan = manual
Nov 14 22:21:16 user nova-compute[76815]: node.session.reopen_max = 0
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].address = 172.16.0.220
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].port = 3260
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].startup = manual
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].tcp.window_size = 524288
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].tcp.type_of_service = 0
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].timeo.logout_timeout = 15
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].timeo.login_timeout = 15
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].timeo.auth_timeout = 45
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].iscsi.DataDigest = None
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].iscsi.IFMarker = No
Nov 14 22:21:16 user nova-compute[76815]: node.conn[0].iscsi.OFMarker = No
Nov 14 22:21:16 user nova-compute[76815]: # END RECORD
Nov 14 22:21:16 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d6211-c204-4100-9d8f-10e39e9464c1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Took 0.57 seconds to deallocate network for instance.
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50c8e21-e52c-4004-89b3-11abe0304634]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKeZslLz {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKeZslLz" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa10710-9e9e-44e2-b789-e9bd26ed152b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cKeZslLz'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0878bbe3-d22f-4cb4-8129-24c83e1a662f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[feccb8d3-7652-47f5-9ef3-dcbe08a1f7ee]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:16 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:16 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:16 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:16 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] HCTL ('33', '0', '0', 0) found on session 36 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36636eb-4681-4206-b233-1cb0d043f493]: (4, ('0 0 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Searching for a device in session 36 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKeZslLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '26363373563643632', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363373563643632', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-937618737',display_name='tempest-ServerStableDeviceRescueTest-server-937618737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-937618737',id=28,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWjtV2c/oN0301FEraICGTVYdbwbdy/i7FSijB+CWm60Jph5H7nN7/o3v3XNaCNyM78hIA8LoU0m7Ji2TCjnVhzdkcmyOVBftbTg185VLlZCVEf5p00+5nZc7auPqUF2Q==',key_name='tempest-keypair-492100224',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:17:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be1bdb986de2488da17a7f44b6bd58e5',ramdisk_id='',reservation_id='r-2nwd1u0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2018122865',owner_user_name='tempest-ServerStableDeviceRescueTest-2018122865-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:19:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='528d6b8363524661ac87940d9c29c521',uuid=9e076b98-3f30-4a9a-aa97-330c748de261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "vif_mac": "fa:16:3e:b6:d8:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Converting VIF {"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "vif_mac": "fa:16:3e:b6:d8:3f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d8:3f,bridge_name='br-int',has_traffic_filtering=True,id=49dbd78d-299e-4717-bf85-1a3ad0e83689,network=Network(69115285-947c-4b22-8c21-62c9d9c3578e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dbd78d-29') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.objects.base [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Object Instance<9e076b98-3f30-4a9a-aa97-330c748de261> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:21:16 user nova-compute[76815]:   <uuid>9e076b98-3f30-4a9a-aa97-330c748de261</uuid>
Nov 14 22:21:16 user nova-compute[76815]:   <name>instance-0000001c</name>
Nov 14 22:21:16 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:21:16 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:21:16 user nova-compute[76815]:   <metadata>
Nov 14 22:21:16 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:21:16 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:21:16 user nova-compute[76815]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-937618737</nova:name>
Nov 14 22:21:16 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:21:16</nova:creationTime>
Nov 14 22:21:16 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:21:16 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:21:16 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:21:16 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:21:16 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:21:16 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:21:16 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:21:16 user nova-compute[76815]:       <nova:owner>
Nov 14 22:21:16 user nova-compute[76815]:         <nova:user uuid="528d6b8363524661ac87940d9c29c521">tempest-ServerStableDeviceRescueTest-2018122865-project-member</nova:user>
Nov 14 22:21:16 user nova-compute[76815]:         <nova:project uuid="be1bdb986de2488da17a7f44b6bd58e5">tempest-ServerStableDeviceRescueTest-2018122865</nova:project>
Nov 14 22:21:16 user nova-compute[76815]:       </nova:owner>
Nov 14 22:21:16 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:21:16 user nova-compute[76815]:       <nova:ports>
Nov 14 22:21:16 user nova-compute[76815]:         <nova:port uuid="49dbd78d-299e-4717-bf85-1a3ad0e83689">
Nov 14 22:21:16 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:21:16 user nova-compute[76815]:         </nova:port>
Nov 14 22:21:16 user nova-compute[76815]:       </nova:ports>
Nov 14 22:21:16 user nova-compute[76815]:     </nova:instance>
Nov 14 22:21:16 user nova-compute[76815]:   </metadata>
Nov 14 22:21:16 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:21:16 user nova-compute[76815]:     <system>
Nov 14 22:21:16 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:21:16 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:21:16 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:21:16 user nova-compute[76815]:       <entry name="serial">9e076b98-3f30-4a9a-aa97-330c748de261</entry>
Nov 14 22:21:16 user nova-compute[76815]:       <entry name="uuid">9e076b98-3f30-4a9a-aa97-330c748de261</entry>
Nov 14 22:21:16 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:21:16 user nova-compute[76815]:     </system>
Nov 14 22:21:16 user nova-compute[76815]:   </sysinfo>
Nov 14 22:21:16 user nova-compute[76815]:   <os>
Nov 14 22:21:16 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:21:16 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:21:16 user nova-compute[76815]:   </os>
Nov 14 22:21:16 user nova-compute[76815]:   <features>
Nov 14 22:21:16 user nova-compute[76815]:     <acpi/>
Nov 14 22:21:16 user nova-compute[76815]:     <apic/>
Nov 14 22:21:16 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:21:16 user nova-compute[76815]:   </features>
Nov 14 22:21:16 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:21:16 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:21:16 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:21:16 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:21:16 user nova-compute[76815]:   </clock>
Nov 14 22:21:16 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:21:16 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:21:16 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:21:16 user nova-compute[76815]:   </cpu>
Nov 14 22:21:16 user nova-compute[76815]:   <devices>
Nov 14 22:21:16 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:21:16 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:21:16 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk"/>
Nov 14 22:21:16 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:21:16 user nova-compute[76815]:     </disk>
Nov 14 22:21:16 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:21:16 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:21:16 user nova-compute[76815]:       <source dev="/dev/sdb"/>
Nov 14 22:21:16 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:21:16 user nova-compute[76815]:       <serial>53ebb970-e00b-458d-a558-407d4eac3d44</serial>
Nov 14 22:21:16 user nova-compute[76815]:     </disk>
Nov 14 22:21:16 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:21:16 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:21:16 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue"/>
Nov 14 22:21:16 user nova-compute[76815]:       <target dev="vdc" bus="virtio"/>
Nov 14 22:21:16 user nova-compute[76815]:       <boot order="1"/>
Nov 14 22:21:16 user nova-compute[76815]:     </disk>
Nov 14 22:21:16 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:21:16 user nova-compute[76815]:       <mac address="fa:16:3e:b6:d8:3f"/>
Nov 14 22:21:16 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:21:16 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:21:16 user nova-compute[76815]:       <target dev="tap49dbd78d-29"/>
Nov 14 22:21:16 user nova-compute[76815]:     </interface>
Nov 14 22:21:16 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:21:16 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/console.log" append="off"/>
Nov 14 22:21:16 user nova-compute[76815]:     </serial>
Nov 14 22:21:16 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:21:16 user nova-compute[76815]:     <video>
Nov 14 22:21:16 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:21:16 user nova-compute[76815]:     </video>
Nov 14 22:21:16 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:21:16 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:21:16 user nova-compute[76815]:     </rng>
Nov 14 22:21:16 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:21:16 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:21:16 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:21:16 user nova-compute[76815]:     </memballoon>
Nov 14 22:21:16 user nova-compute[76815]:   </devices>
Nov 14 22:21:16 user nova-compute[76815]: </domain>
Nov 14 22:21:16 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:21:16 user nova-compute[76815]: INFO nova.network.neutron [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating port 6a9c880b-50a5-4606-9fe5-1e6ad5172aee with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 22:21:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Instance destroyed successfully.
Nov 14 22:21:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] No VIF found with MAC fa:16:3e:b6:d8:3f, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-6654415e-8d49-46ba-a97f-778a9ad262bb req-e6361faa-c15d-4a71-b4cd-a026ad2b0995 service nova] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Received event network-vif-deleted-cb3956f2-83bd-4ad2-a094-05a0c983a4a2 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:17 user nova-compute[76815]: INFO nova.compute.manager [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Took 0.77 seconds to detach 1 volumes for instance.
Nov 14 22:21:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] [instance: 648e61c3-1925-4e22-8dc7-3bd8c0558487] Deleting volume: b98fed93-15d7-4f20-8532-1b940ef1834d {{(pid=76815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquired lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:21:17 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:18 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Deleted allocations for instance 648e61c3-1925-4e22-8dc7-3bd8c0558487
Nov 14 22:21:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-92e46e4c-9a86-4f55-92d0-11e6ee2b18d8 tempest-TestShelveInstance-1419119597 tempest-TestShelveInstance-1419119597-project-member] Lock "648e61c3-1925-4e22-8dc7-3bd8c0558487" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.219s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating instance_info_cache with network_info: [{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Releasing lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:21:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Creating image(s)
Nov 14 22:21:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG nova.objects.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<85f255af-70de-47c0-bc23-e3957542b150> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "07cb8ac75e367ecefa16c9cb59b4182d13b179b3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "07cb8ac75e367ecefa16c9cb59b4182d13b179b3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3.part --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG nova.virt.images [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] 774cbdcf-e040-4b8d-8adf-8c768e4ceaff was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3.part /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-changed-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Refreshing instance network info cache due to event network-changed-6a9c880b-50a5-4606-9fe5-1e6ad5172aee. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] Acquiring lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] Acquired lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:21:19 user nova-compute[76815]: DEBUG nova.network.neutron [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Refreshing network info cache for port 6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG nova.network.neutron [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updated VIF entry in instance network info cache for port 6a9c880b-50a5-4606-9fe5-1e6ad5172aee. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG nova.network.neutron [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating instance_info_cache with network_info: [{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] Releasing lock "refresh_cache-85f255af-70de-47c0-bc23-e3957542b150" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:20 user nova-compute[76815]: WARNING nova.compute.manager [req-72869392-3d67-432b-9329-2f6eabd763d9 req-9c30ad0a-96e1-4598-8289-141638c3a795 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state active and task_state rescuing.
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3.part /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3.converted" returned: 0 in 0.671s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "07cb8ac75e367ecefa16c9cb59b4182d13b179b3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.144s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3 --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "07cb8ac75e367ecefa16c9cb59b4182d13b179b3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "07cb8ac75e367ecefa16c9cb59b4182d13b179b3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3 --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3,backing_fmt=raw /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3,backing_fmt=raw /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk 1073741824" returned: 0 in 0.054s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "07cb8ac75e367ecefa16c9cb59b4182d13b179b3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3 --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'migration_context' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG nova.objects.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<85f255af-70de-47c0-bc23-e3957542b150> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:21:21 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Rebasing disk image.
Nov 14 22:21:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG nova.compute.manager [None req-aa85afea-9823-42cd-b23a-55e5ea43266f tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b -F raw /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-633a64a7-c441-4858-b33a-27473c3d83ce req-1db39945-2727-4538-aeb8-84c29bc3f774 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-633a64a7-c441-4858-b33a-27473c3d83ce req-1db39945-2727-4538-aeb8-84c29bc3f774 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-633a64a7-c441-4858-b33a-27473c3d83ce req-1db39945-2727-4538-aeb8-84c29bc3f774 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-633a64a7-c441-4858-b33a-27473c3d83ce req-1db39945-2727-4538-aeb8-84c29bc3f774 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-633a64a7-c441-4858-b33a-27473c3d83ce req-1db39945-2727-4538-aeb8-84c29bc3f774 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:21 user nova-compute[76815]: WARNING nova.compute.manager [req-633a64a7-c441-4858-b33a-27473c3d83ce req-1db39945-2727-4538-aeb8-84c29bc3f774 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state rescued and task_state None.
Nov 14 22:21:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b -F raw /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk" returned: 0 in 2.433s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Ensure instance console log exists: /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Start _get_guest_xml network_info=[{"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='62e22e46679967884b83008f01ce3c23',container_format='bare',created_at=2023-11-14T22:19:19Z,direct_url=<?>,disk_format='qcow2',id=774cbdcf-e040-4b8d-8adf-8c768e4ceaff,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-196113391-shelved',owner='4bad961b0e704e2483d2de3d382a23b6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T22:19:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGDOYNFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '85f255af-70de-47c0-bc23-e3957542b150', 'attached_at': '', 'detached_at': '', 'volume_id': '08922ff9-c725-420f-a531-09b0cc411951', 'serial': '08922ff9-c725-420f-a531-09b0cc411951'}, 'attachment_id': 'e90cfef4-dcd7-4263-bef4-58f72945ec53', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:21:23 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:23 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='62e22e46679967884b83008f01ce3c23',container_format='bare',created_at=2023-11-14T22:19:19Z,direct_url=<?>,disk_format='qcow2',id=774cbdcf-e040-4b8d-8adf-8c768e4ceaff,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-196113391-shelved',owner='4bad961b0e704e2483d2de3d382a23b6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T22:19:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.objects.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<85f255af-70de-47c0-bc23-e3957542b150> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGDOYNFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:21:23 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:21:23 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:21:23 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a98b57-74cf-4883-bad2-25011e147477]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:21:23 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4007f7da-6287-4cef-bc93-55735448f669]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951] added
Nov 14 22:21:23 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba261196-44ad-4565-b843-71bb29f49b3e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6428bb9d-9e39-4b3e-994d-337913dce074]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGDOYNFg {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KGDOYNFg" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[71abb340-25aa-41bd-bf09-c58768f6ce8b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KGDOYNFg'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[606e737b-c69b-4275-83d7-29fd75dc478b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0535531d-42fd-4a4a-9647-d9141546e6e8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:23 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:23 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:23 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:23 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[145bdf0a-dd40-43e2-8e3d-ec2db037e3f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951, portal: 172.16.0.220,3260]
Nov 14 22:21:23 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951, portal: 172.16.0.220,3260] successful.
Nov 14 22:21:23 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87b59e1-3cb0-442b-a268-7f6394e1d100]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1064e20c-677e-4dfc-9f10-554d66251cad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:24 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:24 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:21:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:24 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:24 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:21:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[940cbb79-fd0e-4faa-a513-19a24079083e]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGDOYNFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23036643832646632', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036643832646632', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-196113391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-196113391',id=29,image_ref='774cbdcf-e040-4b8d-8adf-8c768e4ceaff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-24643289',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-gin1akfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member',shelved_at='2023-11-14T22:19:22.521200',shelved_host='user',shelved_image_id='774cbdcf-e040-4b8d-8adf-8c768e4ceaff'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=85f255af-70de-47c0-bc23-e3957542b150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'pci_devices' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.objects.base [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<85f255af-70de-47c0-bc23-e3957542b150> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:21:25 user nova-compute[76815]:   <uuid>85f255af-70de-47c0-bc23-e3957542b150</uuid>
Nov 14 22:21:25 user nova-compute[76815]:   <name>instance-0000001d</name>
Nov 14 22:21:25 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:21:25 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:21:25 user nova-compute[76815]:   <metadata>
Nov 14 22:21:25 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:21:25 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:21:25 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-196113391</nova:name>
Nov 14 22:21:25 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:21:23</nova:creationTime>
Nov 14 22:21:25 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:21:25 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:21:25 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:21:25 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:21:25 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:21:25 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:21:25 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:21:25 user nova-compute[76815]:       <nova:owner>
Nov 14 22:21:25 user nova-compute[76815]:         <nova:user uuid="50afb4444eea433ba80e4f4e84821101">tempest-AttachVolumeShelveTestJSON-1125875673-project-member</nova:user>
Nov 14 22:21:25 user nova-compute[76815]:         <nova:project uuid="4bad961b0e704e2483d2de3d382a23b6">tempest-AttachVolumeShelveTestJSON-1125875673</nova:project>
Nov 14 22:21:25 user nova-compute[76815]:       </nova:owner>
Nov 14 22:21:25 user nova-compute[76815]:       <nova:root type="image" uuid="774cbdcf-e040-4b8d-8adf-8c768e4ceaff"/>
Nov 14 22:21:25 user nova-compute[76815]:       <nova:ports>
Nov 14 22:21:25 user nova-compute[76815]:         <nova:port uuid="6a9c880b-50a5-4606-9fe5-1e6ad5172aee">
Nov 14 22:21:25 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 22:21:25 user nova-compute[76815]:         </nova:port>
Nov 14 22:21:25 user nova-compute[76815]:       </nova:ports>
Nov 14 22:21:25 user nova-compute[76815]:     </nova:instance>
Nov 14 22:21:25 user nova-compute[76815]:   </metadata>
Nov 14 22:21:25 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:21:25 user nova-compute[76815]:     <system>
Nov 14 22:21:25 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:21:25 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:21:25 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:21:25 user nova-compute[76815]:       <entry name="serial">85f255af-70de-47c0-bc23-e3957542b150</entry>
Nov 14 22:21:25 user nova-compute[76815]:       <entry name="uuid">85f255af-70de-47c0-bc23-e3957542b150</entry>
Nov 14 22:21:25 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:21:25 user nova-compute[76815]:     </system>
Nov 14 22:21:25 user nova-compute[76815]:   </sysinfo>
Nov 14 22:21:25 user nova-compute[76815]:   <os>
Nov 14 22:21:25 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:21:25 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:21:25 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:21:25 user nova-compute[76815]:   </os>
Nov 14 22:21:25 user nova-compute[76815]:   <features>
Nov 14 22:21:25 user nova-compute[76815]:     <acpi/>
Nov 14 22:21:25 user nova-compute[76815]:     <apic/>
Nov 14 22:21:25 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:21:25 user nova-compute[76815]:   </features>
Nov 14 22:21:25 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:21:25 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:21:25 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:21:25 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:21:25 user nova-compute[76815]:   </clock>
Nov 14 22:21:25 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:21:25 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:21:25 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:21:25 user nova-compute[76815]:   </cpu>
Nov 14 22:21:25 user nova-compute[76815]:   <devices>
Nov 14 22:21:25 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:21:25 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:21:25 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk"/>
Nov 14 22:21:25 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:21:25 user nova-compute[76815]:     </disk>
Nov 14 22:21:25 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:21:25 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:21:25 user nova-compute[76815]:       <source dev="/dev/sdc"/>
Nov 14 22:21:25 user nova-compute[76815]:       <target dev="vdc" bus="virtio"/>
Nov 14 22:21:25 user nova-compute[76815]:       <serial>08922ff9-c725-420f-a531-09b0cc411951</serial>
Nov 14 22:21:25 user nova-compute[76815]:     </disk>
Nov 14 22:21:25 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:21:25 user nova-compute[76815]:       <mac address="fa:16:3e:55:43:4f"/>
Nov 14 22:21:25 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:21:25 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:21:25 user nova-compute[76815]:       <target dev="tap6a9c880b-50"/>
Nov 14 22:21:25 user nova-compute[76815]:     </interface>
Nov 14 22:21:25 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:21:25 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/console.log" append="off"/>
Nov 14 22:21:25 user nova-compute[76815]:     </serial>
Nov 14 22:21:25 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:21:25 user nova-compute[76815]:     <video>
Nov 14 22:21:25 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:21:25 user nova-compute[76815]:     </video>
Nov 14 22:21:25 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:21:25 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:21:25 user nova-compute[76815]:     </rng>
Nov 14 22:21:25 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:21:25 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:21:25 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:21:25 user nova-compute[76815]:     </memballoon>
Nov 14 22:21:25 user nova-compute[76815]:   </devices>
Nov 14 22:21:25 user nova-compute[76815]: </domain>
Nov 14 22:21:25 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-196113391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-196113391',id=29,image_ref='774cbdcf-e040-4b8d-8adf-8c768e4ceaff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-24643289',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-gin1akfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member',shelved_at='2023-11-14T22:19:22.521200',shelved_host='user',shelved_image_id='774cbdcf-e040-4b8d-8adf-8c768e4ceaff'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=85f255af-70de-47c0-bc23-e3957542b150,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG os_vif [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47b994bd-23f7-582e-bb5b-1a881133ff38', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a9c880b-50, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a9c880b-50, col_values=(('qos', UUID('e468d27c-491d-4dfe-87d5-0b61c8222bda')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a9c880b-50, col_values=(('external_ids', {'iface-id': '6a9c880b-50a5-4606-9fe5-1e6ad5172aee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:43:4f', 'vm-uuid': '85f255af-70de-47c0-bc23-e3957542b150'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:25 user nova-compute[76815]: INFO os_vif [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50')
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:21:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] No VIF found with MAC fa:16:3e:55:43:4f, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:21:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-39a921e8-de4f-474b-b278-795b9f9e3857 req-6fd9c615-2c95-4bb9-be28-d51015354a3c service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-39a921e8-de4f-474b-b278-795b9f9e3857 req-6fd9c615-2c95-4bb9-be28-d51015354a3c service nova] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-39a921e8-de4f-474b-b278-795b9f9e3857 req-6fd9c615-2c95-4bb9-be28-d51015354a3c service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-39a921e8-de4f-474b-b278-795b9f9e3857 req-6fd9c615-2c95-4bb9-be28-d51015354a3c service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-39a921e8-de4f-474b-b278-795b9f9e3857 req-6fd9c615-2c95-4bb9-be28-d51015354a3c service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] No waiting events found dispatching network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:27 user nova-compute[76815]: WARNING nova.compute.manager [req-39a921e8-de4f-474b-b278-795b9f9e3857 req-6fd9c615-2c95-4bb9-be28-d51015354a3c service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received unexpected event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 22:21:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:29 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:21:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:21:29 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance spawned successfully.
Nov 14 22:21:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ed7431b-b930-470b-baee-f95fc988aab7 req-d3fbc854-36b5-4e21-8829-1a16514856f7 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ed7431b-b930-470b-baee-f95fc988aab7 req-d3fbc854-36b5-4e21-8829-1a16514856f7 service nova] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ed7431b-b930-470b-baee-f95fc988aab7 req-d3fbc854-36b5-4e21-8829-1a16514856f7 service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ed7431b-b930-470b-baee-f95fc988aab7 req-d3fbc854-36b5-4e21-8829-1a16514856f7 service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ed7431b-b930-470b-baee-f95fc988aab7 req-d3fbc854-36b5-4e21-8829-1a16514856f7 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] No waiting events found dispatching network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:29 user nova-compute[76815]: WARNING nova.compute.manager [req-6ed7431b-b930-470b-baee-f95fc988aab7 req-d3fbc854-36b5-4e21-8829-1a16514856f7 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received unexpected event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 22:21:29 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:21:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f7ad61bd-d06a-4be0-bd2d-cf97eb0584a2 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.288s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:36 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:21:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8175MB free_disk=24.984031677246094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:21:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 9e076b98-3f30-4a9a-aa97-330c748de261 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 85f255af-70de-47c0-bc23-e3957542b150 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:21:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:42 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:21:43 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:21:44 user nova-compute[76815]: INFO nova.compute.claims [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Claim successful on node user
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updating instance_info_cache with network_info: [{"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:21:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG nova.policy [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd5c7c940b0429994db55b93cb421ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673708a9f12541f6929c86eb60ca83c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:21:44 user nova-compute[76815]: INFO nova.virt.block_device [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Booting with volume 4d984fe4-59de-44c9-a2f3-29b71f1d854a at /dev/vda
Nov 14 22:21:44 user nova-compute[76815]: DEBUG os_brick.utils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de14e8d5-b82e-48f8-8ef5-c6a2eddef19d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b00e828-eeff-4444-af9b-98b53bc0f944]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e8ef8-06f7-412e-9775-32e677dcb26b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcd35ad-ed72-401f-906c-e9d332eeb486]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:21:45 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:21:45 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e611db1-49cf-4153-bda4-f56f0d958b99]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG os_brick.utils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Updating existing volume attachment record: 22e34052-9b82-4728-a607-0a47fb8f2e90 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Successfully created port: 40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Successfully updated port: 40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "refresh_cache-20dd4416-3dc0-4ca0-bca0-3cceafbb7925" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquired lock "refresh_cache-20dd4416-3dc0-4ca0-bca0-3cceafbb7925" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-c34bc79e-3e46-4afe-97ee-ee61a7f57acb req-989108fc-1dc9-47d2-a495-e36262e6cd99 service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received event network-changed-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-c34bc79e-3e46-4afe-97ee-ee61a7f57acb req-989108fc-1dc9-47d2-a495-e36262e6cd99 service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Refreshing instance network info cache due to event network-changed-40a09f29-a223-4a6c-9491-e210fcc849d8. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c34bc79e-3e46-4afe-97ee-ee61a7f57acb req-989108fc-1dc9-47d2-a495-e36262e6cd99 service nova] Acquiring lock "refresh_cache-20dd4416-3dc0-4ca0-bca0-3cceafbb7925" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Updating instance_info_cache with network_info: [{"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Releasing lock "refresh_cache-20dd4416-3dc0-4ca0-bca0-3cceafbb7925" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Instance network_info: |[{"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c34bc79e-3e46-4afe-97ee-ee61a7f57acb req-989108fc-1dc9-47d2-a495-e36262e6cd99 service nova] Acquired lock "refresh_cache-20dd4416-3dc0-4ca0-bca0-3cceafbb7925" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-c34bc79e-3e46-4afe-97ee-ee61a7f57acb req-989108fc-1dc9-47d2-a495-e36262e6cd99 service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Refreshing network info cache for port 40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-c34bc79e-3e46-4afe-97ee-ee61a7f57acb req-989108fc-1dc9-47d2-a495-e36262e6cd99 service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Updated VIF entry in instance network info cache for port 40a09f29-a223-4a6c-9491-e210fcc849d8. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-c34bc79e-3e46-4afe-97ee-ee61a7f57acb req-989108fc-1dc9-47d2-a495-e36262e6cd99 service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Updating instance_info_cache with network_info: [{"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:21:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c34bc79e-3e46-4afe-97ee-ee61a7f57acb req-989108fc-1dc9-47d2-a495-e36262e6cd99 service nova] Releasing lock "refresh_cache-20dd4416-3dc0-4ca0-bca0-3cceafbb7925" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:21:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:21:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Creating image(s)
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Ensure instance console log exists: /opt/stack/data/nova/instances/20dd4416-3dc0-4ca0-bca0-3cceafbb7925/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Start _get_guest_xml network_info=[{"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTaBkxLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20dd4416-3dc0-4ca0-bca0-3cceafbb7925', 'attached_at': '', 'detached_at': '', 'volume_id': '4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'serial': '4d984fe4-59de-44c9-a2f3-29b71f1d854a'}, 'attachment_id': '22e34052-9b82-4728-a607-0a47fb8f2e90', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:21:49 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:49 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTaBkxLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:21:49 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:21:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:21:49 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:21:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:21:49 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b9ead-56d0-436d-b8b0-eb70d8a334b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:21:49 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7c1a28-7ffc-42d8-89ba-8510f3c250c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a] added
Nov 14 22:21:49 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83e8ef0-bb31-44bf-b11a-326896afa625]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f7f034-5e09-4010-9e2d-a75b8aaae179]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTaBkxLV {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTaBkxLV" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[279f42f6-7003-464e-a732-614138528f5c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTaBkxLV'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23f1ba7-57e6-4869-81f1-e16380fc4abc]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5cc36c-4311-49c0-9152-f4b4ed52e0fd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:21:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:21:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[355ec0cb-3914-4081-8dd2-788f734172b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260]
Nov 14 22:21:50 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260] successful.
Nov 14 22:21:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b422711-78d8-4f31-93a6-e8a220d39989]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d07011-50a1-430f-a533-1ba8a605cd48]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:21:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:21:50 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:21:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb80618-88ad-4012-acf6-c41d1e262bfb]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTaBkxLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:21:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23766356563356235', 'path': '/dev/sde'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766356563356235', 'path': '/dev/sde'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2096198901',display_name='tempest-TestVolumeBootPattern-server-2096198901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2096198901',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVEyUh19O0alKw62tv3KmxoqsN7lyGaF0+P2xIoHxT+cKRRBx4MW7gidGmxry5UdKm4qrUC1sXQJe9NOXzjEcpENxKgmVXT2xLtMcWY8QrB8wG3DfxFfdkpczVqlfoPA==',key_name='tempest-TestVolumeBootPattern-1688630530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-8ohz02dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:21:45Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=20dd4416-3dc0-4ca0-bca0-3cceafbb7925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:3f,bridge_name='br-int',has_traffic_filtering=True,id=40a09f29-a223-4a6c-9491-e210fcc849d8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a09f29-a2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'pci_devices' on Instance uuid 20dd4416-3dc0-4ca0-bca0-3cceafbb7925 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:21:51 user nova-compute[76815]:   <uuid>20dd4416-3dc0-4ca0-bca0-3cceafbb7925</uuid>
Nov 14 22:21:51 user nova-compute[76815]:   <name>instance-00000020</name>
Nov 14 22:21:51 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:21:51 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:21:51 user nova-compute[76815]:   <metadata>
Nov 14 22:21:51 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:21:51 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:21:51 user nova-compute[76815]:       <nova:name>tempest-TestVolumeBootPattern-server-2096198901</nova:name>
Nov 14 22:21:51 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:21:49</nova:creationTime>
Nov 14 22:21:51 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:21:51 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:21:51 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:21:51 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:21:51 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:21:51 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:21:51 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:21:51 user nova-compute[76815]:       <nova:owner>
Nov 14 22:21:51 user nova-compute[76815]:         <nova:user uuid="0fd5c7c940b0429994db55b93cb421ed">tempest-TestVolumeBootPattern-1821264948-project-member</nova:user>
Nov 14 22:21:51 user nova-compute[76815]:         <nova:project uuid="673708a9f12541f6929c86eb60ca83c8">tempest-TestVolumeBootPattern-1821264948</nova:project>
Nov 14 22:21:51 user nova-compute[76815]:       </nova:owner>
Nov 14 22:21:51 user nova-compute[76815]:       <nova:ports>
Nov 14 22:21:51 user nova-compute[76815]:         <nova:port uuid="40a09f29-a223-4a6c-9491-e210fcc849d8">
Nov 14 22:21:51 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 22:21:51 user nova-compute[76815]:         </nova:port>
Nov 14 22:21:51 user nova-compute[76815]:       </nova:ports>
Nov 14 22:21:51 user nova-compute[76815]:     </nova:instance>
Nov 14 22:21:51 user nova-compute[76815]:   </metadata>
Nov 14 22:21:51 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:21:51 user nova-compute[76815]:     <system>
Nov 14 22:21:51 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:21:51 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:21:51 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:21:51 user nova-compute[76815]:       <entry name="serial">20dd4416-3dc0-4ca0-bca0-3cceafbb7925</entry>
Nov 14 22:21:51 user nova-compute[76815]:       <entry name="uuid">20dd4416-3dc0-4ca0-bca0-3cceafbb7925</entry>
Nov 14 22:21:51 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:21:51 user nova-compute[76815]:     </system>
Nov 14 22:21:51 user nova-compute[76815]:   </sysinfo>
Nov 14 22:21:51 user nova-compute[76815]:   <os>
Nov 14 22:21:51 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:21:51 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:21:51 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:21:51 user nova-compute[76815]:   </os>
Nov 14 22:21:51 user nova-compute[76815]:   <features>
Nov 14 22:21:51 user nova-compute[76815]:     <acpi/>
Nov 14 22:21:51 user nova-compute[76815]:     <apic/>
Nov 14 22:21:51 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:21:51 user nova-compute[76815]:   </features>
Nov 14 22:21:51 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:21:51 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:21:51 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:21:51 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:21:51 user nova-compute[76815]:   </clock>
Nov 14 22:21:51 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:21:51 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:21:51 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:21:51 user nova-compute[76815]:   </cpu>
Nov 14 22:21:51 user nova-compute[76815]:   <devices>
Nov 14 22:21:51 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:21:51 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:21:51 user nova-compute[76815]:       <source dev="/dev/sde"/>
Nov 14 22:21:51 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:21:51 user nova-compute[76815]:       <serial>4d984fe4-59de-44c9-a2f3-29b71f1d854a</serial>
Nov 14 22:21:51 user nova-compute[76815]:     </disk>
Nov 14 22:21:51 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:21:51 user nova-compute[76815]:       <mac address="fa:16:3e:42:3b:3f"/>
Nov 14 22:21:51 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:21:51 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:21:51 user nova-compute[76815]:       <target dev="tap40a09f29-a2"/>
Nov 14 22:21:51 user nova-compute[76815]:     </interface>
Nov 14 22:21:51 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:21:51 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/20dd4416-3dc0-4ca0-bca0-3cceafbb7925/console.log" append="off"/>
Nov 14 22:21:51 user nova-compute[76815]:     </serial>
Nov 14 22:21:51 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:21:51 user nova-compute[76815]:     <video>
Nov 14 22:21:51 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:21:51 user nova-compute[76815]:     </video>
Nov 14 22:21:51 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:21:51 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:21:51 user nova-compute[76815]:     </rng>
Nov 14 22:21:51 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:21:51 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:21:51 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:21:51 user nova-compute[76815]:     </memballoon>
Nov 14 22:21:51 user nova-compute[76815]:   </devices>
Nov 14 22:21:51 user nova-compute[76815]: </domain>
Nov 14 22:21:51 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2096198901',display_name='tempest-TestVolumeBootPattern-server-2096198901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2096198901',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVEyUh19O0alKw62tv3KmxoqsN7lyGaF0+P2xIoHxT+cKRRBx4MW7gidGmxry5UdKm4qrUC1sXQJe9NOXzjEcpENxKgmVXT2xLtMcWY8QrB8wG3DfxFfdkpczVqlfoPA==',key_name='tempest-TestVolumeBootPattern-1688630530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-8ohz02dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:21:45Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=20dd4416-3dc0-4ca0-bca0-3cceafbb7925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:3f,bridge_name='br-int',has_traffic_filtering=True,id=40a09f29-a223-4a6c-9491-e210fcc849d8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a09f29-a2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG os_vif [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:3f,bridge_name='br-int',has_traffic_filtering=True,id=40a09f29-a223-4a6c-9491-e210fcc849d8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a09f29-a2') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e52dabf0-1b3c-5402-ac53-fa5f69a4d865', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40a09f29-a2, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40a09f29-a2, col_values=(('qos', UUID('13711941-9c8e-4171-ae2e-614edd0bb081')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40a09f29-a2, col_values=(('external_ids', {'iface-id': '40a09f29-a223-4a6c-9491-e210fcc849d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:3b:3f', 'vm-uuid': '20dd4416-3dc0-4ca0-bca0-3cceafbb7925'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:51 user nova-compute[76815]: INFO os_vif [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:3f,bridge_name='br-int',has_traffic_filtering=True,id=40a09f29-a223-4a6c-9491-e210fcc849d8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a09f29-a2')
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:21:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No VIF found with MAC fa:16:3e:42:3b:3f, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:21:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-5283266a-8415-44b1-abe2-fa77eea1091d req-41ac8275-0989-41f6-bea6-74223697fdfe service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received event network-vif-plugged-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5283266a-8415-44b1-abe2-fa77eea1091d req-41ac8275-0989-41f6-bea6-74223697fdfe service nova] Acquiring lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5283266a-8415-44b1-abe2-fa77eea1091d req-41ac8275-0989-41f6-bea6-74223697fdfe service nova] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5283266a-8415-44b1-abe2-fa77eea1091d req-41ac8275-0989-41f6-bea6-74223697fdfe service nova] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-5283266a-8415-44b1-abe2-fa77eea1091d req-41ac8275-0989-41f6-bea6-74223697fdfe service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] No waiting events found dispatching network-vif-plugged-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:52 user nova-compute[76815]: WARNING nova.compute.manager [req-5283266a-8415-44b1-abe2-fa77eea1091d req-41ac8275-0989-41f6-bea6-74223697fdfe service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received unexpected event network-vif-plugged-40a09f29-a223-4a6c-9491-e210fcc849d8 for instance with vm_state building and task_state spawning.
Nov 14 22:21:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:21:54 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Instance spawned successfully.
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:21:54 user nova-compute[76815]: INFO nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-845193c6-c21a-4ad0-b514-4d9ab5bd4fa5 req-8875fc4a-40ba-4756-9167-891ae56479d3 service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received event network-vif-plugged-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-845193c6-c21a-4ad0-b514-4d9ab5bd4fa5 req-8875fc4a-40ba-4756-9167-891ae56479d3 service nova] Acquiring lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-845193c6-c21a-4ad0-b514-4d9ab5bd4fa5 req-8875fc4a-40ba-4756-9167-891ae56479d3 service nova] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-845193c6-c21a-4ad0-b514-4d9ab5bd4fa5 req-8875fc4a-40ba-4756-9167-891ae56479d3 service nova] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-845193c6-c21a-4ad0-b514-4d9ab5bd4fa5 req-8875fc4a-40ba-4756-9167-891ae56479d3 service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] No waiting events found dispatching network-vif-plugged-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:21:54 user nova-compute[76815]: WARNING nova.compute.manager [req-845193c6-c21a-4ad0-b514-4d9ab5bd4fa5 req-8875fc4a-40ba-4756-9167-891ae56479d3 service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received unexpected event network-vif-plugged-40a09f29-a223-4a6c-9491-e210fcc849d8 for instance with vm_state building and task_state spawning.
Nov 14 22:21:54 user nova-compute[76815]: INFO nova.compute.manager [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Took 10.49 seconds to build instance.
Nov 14 22:21:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-40ec30c4-66f2-460a-ac93-cc1e3aade187 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.603s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:21:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:21:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:22:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:22:13 user nova-compute[76815]: INFO nova.compute.claims [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Claim successful on node user
Nov 14 22:22:13 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG nova.network.neutron [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:22:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:22:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:22:13 user nova-compute[76815]: INFO nova.virt.block_device [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Booting with volume ee8f1159-f512-44d0-aa1e-ef39e3880c8c at /dev/vda
Nov 14 22:22:13 user nova-compute[76815]: DEBUG nova.policy [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85a900897f3a42bd89f966f4b7e253f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b7e88b0ec54c5b9f15ae859e8c3984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG os_brick.utils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf053bc-bcc4-4652-a4f6-86e0d782d8bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1534b0ef-138f-4d06-92db-c7e2e3a31193]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f2b62a-d5c9-418f-b4f7-fa5b81bdeb4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c4e828-b232-435d-adda-cb2d72fb7a6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:22:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:22:14 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:22:14 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf0adc-ea19-4dba-b196-512a6a6c00a5]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:22:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:22:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:22:14 user nova-compute[76815]: DEBUG os_brick.utils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:22:14 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating existing volume attachment record: 9f25a4e4-29ee-4f07-99b6-e2d25255013f {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:22:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Successfully created port: 25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Successfully updated port: 25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquired lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-32a5eccb-f559-456d-beb4-f12a8f7b18f9 req-ebaa6414-5f2e-4df8-bf26-1da0260cefe5 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-changed-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-32a5eccb-f559-456d-beb4-f12a8f7b18f9 req-ebaa6414-5f2e-4df8-bf26-1da0260cefe5 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Refreshing instance network info cache due to event network-changed-25c739be-c20c-4d5a-885e-ef0ad796a1fe. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-32a5eccb-f559-456d-beb4-f12a8f7b18f9 req-ebaa6414-5f2e-4df8-bf26-1da0260cefe5 service nova] Acquiring lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating instance_info_cache with network_info: [{"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Releasing lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Instance network_info: |[{"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-32a5eccb-f559-456d-beb4-f12a8f7b18f9 req-ebaa6414-5f2e-4df8-bf26-1da0260cefe5 service nova] Acquired lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-32a5eccb-f559-456d-beb4-f12a8f7b18f9 req-ebaa6414-5f2e-4df8-bf26-1da0260cefe5 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Refreshing network info cache for port 25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-32a5eccb-f559-456d-beb4-f12a8f7b18f9 req-ebaa6414-5f2e-4df8-bf26-1da0260cefe5 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updated VIF entry in instance network info cache for port 25c739be-c20c-4d5a-885e-ef0ad796a1fe. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-32a5eccb-f559-456d-beb4-f12a8f7b18f9 req-ebaa6414-5f2e-4df8-bf26-1da0260cefe5 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating instance_info_cache with network_info: [{"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:22:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-32a5eccb-f559-456d-beb4-f12a8f7b18f9 req-ebaa6414-5f2e-4df8-bf26-1da0260cefe5 service nova] Releasing lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:22:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:22:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Creating image(s)
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Ensure instance console log exists: /opt/stack/data/nova/instances/3d82c8bf-899a-4e18-9738-8b6d067867bf/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Start _get_guest_xml network_info=[{"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRQLWaPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d82c8bf-899a-4e18-9738-8b6d067867bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'serial': 'ee8f1159-f512-44d0-aa1e-ef39e3880c8c'}, 'attachment_id': '9f25a4e4-29ee-4f07-99b6-e2d25255013f', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:22:20 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:22:20 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRQLWaPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:22:20 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:22:20 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:22:20 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5ff820-0dac-4bc9-b5ba-6c8721267f12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:22:20 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb11d5f-6773-4db3-bb65-d60fd9940309]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c] added
Nov 14 22:22:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[079ee1ab-7ab0-41af-aca5-b87ab93717c4]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0ff04f-0cec-4a37-abac-48ce1cb46dda]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fRQLWaPN {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fRQLWaPN" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb077b7-9655-4357-9472-ead83dc90ced]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fRQLWaPN'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a862be78-ef9c-4081-98dc-33eeb46d0787]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ad6543-f219-441a-8f0b-783d151d5420]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:22:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:22:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0108b6e0-25d5-4fda-91a0-f6cf12ab983e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260]
Nov 14 22:22:20 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260] successful.
Nov 14 22:22:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65f2b8a-8419-4971-aa50-4dd123845469]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ae1d00-4add-4ead-a8d8-821b5ffb134b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:22:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:22:20 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:22:20 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[280f0503-811a-467c-8a0b-71b92a83f6a3]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:22:20 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRQLWaPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23630306465316231', 'path': '/dev/sdf'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630306465316231', 'path': '/dev/sdf'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1598603901',display_name='tempest-ServerActionsTestOtherA-server-1598603901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1598603901',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVfME04PD9rglznppi8Ho3+jsumiOYFPtvR+yy+S2ej5C5M3kJOl8pyG4taHWLiqRqGcIU6SfKKWEu+JVsdH1FsdhxYcOosylxiuo+4fsZkdlqozg87LpEdVgLP6QXNw==',key_name='tempest-keypair-1998197341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-ojj0ei0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=3d82c8bf-899a-4e18-9738-8b6d067867bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.objects.instance [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d82c8bf-899a-4e18-9738-8b6d067867bf {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:22:21 user nova-compute[76815]:   <uuid>3d82c8bf-899a-4e18-9738-8b6d067867bf</uuid>
Nov 14 22:22:21 user nova-compute[76815]:   <name>instance-00000021</name>
Nov 14 22:22:21 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:22:21 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:22:21 user nova-compute[76815]:   <metadata>
Nov 14 22:22:21 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:22:21 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:22:21 user nova-compute[76815]:       <nova:name>tempest-ServerActionsTestOtherA-server-1598603901</nova:name>
Nov 14 22:22:21 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:22:20</nova:creationTime>
Nov 14 22:22:21 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:22:21 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:22:21 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:22:21 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:22:21 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:22:21 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:22:21 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:22:21 user nova-compute[76815]:       <nova:owner>
Nov 14 22:22:21 user nova-compute[76815]:         <nova:user uuid="85a900897f3a42bd89f966f4b7e253f6">tempest-ServerActionsTestOtherA-2016206168-project-member</nova:user>
Nov 14 22:22:21 user nova-compute[76815]:         <nova:project uuid="60b7e88b0ec54c5b9f15ae859e8c3984">tempest-ServerActionsTestOtherA-2016206168</nova:project>
Nov 14 22:22:21 user nova-compute[76815]:       </nova:owner>
Nov 14 22:22:21 user nova-compute[76815]:       <nova:ports>
Nov 14 22:22:21 user nova-compute[76815]:         <nova:port uuid="25c739be-c20c-4d5a-885e-ef0ad796a1fe">
Nov 14 22:22:21 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 22:22:21 user nova-compute[76815]:         </nova:port>
Nov 14 22:22:21 user nova-compute[76815]:       </nova:ports>
Nov 14 22:22:21 user nova-compute[76815]:     </nova:instance>
Nov 14 22:22:21 user nova-compute[76815]:   </metadata>
Nov 14 22:22:21 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:22:21 user nova-compute[76815]:     <system>
Nov 14 22:22:21 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:22:21 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:22:21 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:22:21 user nova-compute[76815]:       <entry name="serial">3d82c8bf-899a-4e18-9738-8b6d067867bf</entry>
Nov 14 22:22:21 user nova-compute[76815]:       <entry name="uuid">3d82c8bf-899a-4e18-9738-8b6d067867bf</entry>
Nov 14 22:22:21 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:22:21 user nova-compute[76815]:     </system>
Nov 14 22:22:21 user nova-compute[76815]:   </sysinfo>
Nov 14 22:22:21 user nova-compute[76815]:   <os>
Nov 14 22:22:21 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:22:21 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:22:21 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:22:21 user nova-compute[76815]:   </os>
Nov 14 22:22:21 user nova-compute[76815]:   <features>
Nov 14 22:22:21 user nova-compute[76815]:     <acpi/>
Nov 14 22:22:21 user nova-compute[76815]:     <apic/>
Nov 14 22:22:21 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:22:21 user nova-compute[76815]:   </features>
Nov 14 22:22:21 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:22:21 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:22:21 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:22:21 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:22:21 user nova-compute[76815]:   </clock>
Nov 14 22:22:21 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:22:21 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:22:21 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:22:21 user nova-compute[76815]:   </cpu>
Nov 14 22:22:21 user nova-compute[76815]:   <devices>
Nov 14 22:22:21 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:22:21 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:22:21 user nova-compute[76815]:       <source dev="/dev/sdf"/>
Nov 14 22:22:21 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:22:21 user nova-compute[76815]:       <serial>ee8f1159-f512-44d0-aa1e-ef39e3880c8c</serial>
Nov 14 22:22:21 user nova-compute[76815]:     </disk>
Nov 14 22:22:21 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:22:21 user nova-compute[76815]:       <mac address="fa:16:3e:6c:92:d9"/>
Nov 14 22:22:21 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:22:21 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:22:21 user nova-compute[76815]:       <target dev="tap25c739be-c2"/>
Nov 14 22:22:21 user nova-compute[76815]:     </interface>
Nov 14 22:22:21 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:22:21 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/3d82c8bf-899a-4e18-9738-8b6d067867bf/console.log" append="off"/>
Nov 14 22:22:21 user nova-compute[76815]:     </serial>
Nov 14 22:22:21 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:22:21 user nova-compute[76815]:     <video>
Nov 14 22:22:21 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:22:21 user nova-compute[76815]:     </video>
Nov 14 22:22:21 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:22:21 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:22:21 user nova-compute[76815]:     </rng>
Nov 14 22:22:21 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:22:21 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:22:21 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:22:21 user nova-compute[76815]:     </memballoon>
Nov 14 22:22:21 user nova-compute[76815]:   </devices>
Nov 14 22:22:21 user nova-compute[76815]: </domain>
Nov 14 22:22:21 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1598603901',display_name='tempest-ServerActionsTestOtherA-server-1598603901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1598603901',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVfME04PD9rglznppi8Ho3+jsumiOYFPtvR+yy+S2ej5C5M3kJOl8pyG4taHWLiqRqGcIU6SfKKWEu+JVsdH1FsdhxYcOosylxiuo+4fsZkdlqozg87LpEdVgLP6QXNw==',key_name='tempest-keypair-1998197341',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-ojj0ei0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=3d82c8bf-899a-4e18-9738-8b6d067867bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG os_vif [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e391469e-449c-54da-a290-4ef3df4941ef', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25c739be-c2, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25c739be-c2, col_values=(('qos', UUID('a9452669-7e5c-4f5d-bdb9-0f8ab5601ee3')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25c739be-c2, col_values=(('external_ids', {'iface-id': '25c739be-c20c-4d5a-885e-ef0ad796a1fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:92:d9', 'vm-uuid': '3d82c8bf-899a-4e18-9738-8b6d067867bf'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:21 user nova-compute[76815]: INFO os_vif [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2')
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:22:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No VIF found with MAC fa:16:3e:6c:92:d9, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:22:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-0ec88207-9499-45df-a054-3c8f942973ca req-cc9c81b2-16e6-44b0-862b-4a018116ddcf service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:22:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0ec88207-9499-45df-a054-3c8f942973ca req-cc9c81b2-16e6-44b0-862b-4a018116ddcf service nova] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:22:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0ec88207-9499-45df-a054-3c8f942973ca req-cc9c81b2-16e6-44b0-862b-4a018116ddcf service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:22:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0ec88207-9499-45df-a054-3c8f942973ca req-cc9c81b2-16e6-44b0-862b-4a018116ddcf service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:22:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-0ec88207-9499-45df-a054-3c8f942973ca req-cc9c81b2-16e6-44b0-862b-4a018116ddcf service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] No waiting events found dispatching network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:22:23 user nova-compute[76815]: WARNING nova.compute.manager [req-0ec88207-9499-45df-a054-3c8f942973ca req-cc9c81b2-16e6-44b0-862b-4a018116ddcf service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received unexpected event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe for instance with vm_state building and task_state spawning.
Nov 14 22:22:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:22:25 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Instance spawned successfully.
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-d88aa6b9-f67d-4fa4-a839-0109dfdc1c7d req-7830cec3-9ddb-43df-b419-9fe09828434f service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d88aa6b9-f67d-4fa4-a839-0109dfdc1c7d req-7830cec3-9ddb-43df-b419-9fe09828434f service nova] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d88aa6b9-f67d-4fa4-a839-0109dfdc1c7d req-7830cec3-9ddb-43df-b419-9fe09828434f service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d88aa6b9-f67d-4fa4-a839-0109dfdc1c7d req-7830cec3-9ddb-43df-b419-9fe09828434f service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-d88aa6b9-f67d-4fa4-a839-0109dfdc1c7d req-7830cec3-9ddb-43df-b419-9fe09828434f service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] No waiting events found dispatching network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:22:25 user nova-compute[76815]: WARNING nova.compute.manager [req-d88aa6b9-f67d-4fa4-a839-0109dfdc1c7d req-7830cec3-9ddb-43df-b419-9fe09828434f service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received unexpected event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe for instance with vm_state building and task_state spawning.
Nov 14 22:22:25 user nova-compute[76815]: INFO nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 14 22:22:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:22:25 user nova-compute[76815]: INFO nova.compute.manager [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Took 12.20 seconds to build instance.
Nov 14 22:22:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-05e5d23f-6955-43cc-b8d3-686883b3d8de tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.300s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:22:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:22:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:22:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:22:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:22:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:22:38 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:22:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:41 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:22:41 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8067MB free_disk=24.978755950927734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 9e076b98-3f30-4a9a-aa97-330c748de261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 85f255af-70de-47c0-bc23-e3957542b150 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 20dd4416-3dc0-4ca0-bca0-3cceafbb7925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3d82c8bf-899a-4e18-9738-8b6d067867bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:22:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:22:42 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:22:42 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:22:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:22:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:22:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:43 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:22:43 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:22:43 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:22:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:22:45 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating instance_info_cache with network_info: [{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:22:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:22:49 user nova-compute[76815]: INFO nova.compute.manager [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] instance snapshotting
Nov 14 22:22:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Beginning live snapshot process
Nov 14 22:22:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json -f qcow2 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json -f qcow2 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9wtcr8nj/3c07d40e1e07401cac86097ee3420472.delta 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9wtcr8nj/3c07d40e1e07401cac86097ee3420472.delta 1073741824" returned: 0 in 0.053s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:50 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 22:22:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:22:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=76815) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 22:22:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 22:22:51 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:22:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9wtcr8nj/3c07d40e1e07401cac86097ee3420472.delta /opt/stack/data/nova/instances/snapshots/tmp9wtcr8nj/3c07d40e1e07401cac86097ee3420472 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:22:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9wtcr8nj/3c07d40e1e07401cac86097ee3420472.delta /opt/stack/data/nova/instances/snapshots/tmp9wtcr8nj/3c07d40e1e07401cac86097ee3420472" returned: 0 in 0.406s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:22:52 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Snapshot extracted, beginning image upload
Nov 14 22:22:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:54 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Snapshot image upload complete
Nov 14 22:22:54 user nova-compute[76815]: INFO nova.compute.manager [None req-e9a70ad4-1b00-4171-aaa9-423822d1da5e tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Took 4.79 seconds to snapshot the instance on the hypervisor.
Nov 14 22:22:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:22:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:01 user nova-compute[76815]: INFO nova.compute.manager [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Detaching volume 08922ff9-c725-420f-a531-09b0cc411951
Nov 14 22:23:01 user nova-compute[76815]: INFO nova.virt.block_device [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Attempting to driver detach volume 08922ff9-c725-420f-a531-09b0cc411951 from mountpoint /dev/vdc
Nov 14 22:23:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Attempting to detach device vdc from instance 85f255af-70de-47c0-bc23-e3957542b150 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:23:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:23:01 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:23:01 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:23:01 user nova-compute[76815]:   <target dev="vdc" bus="virtio"/>
Nov 14 22:23:01 user nova-compute[76815]:   <serial>08922ff9-c725-420f-a531-09b0cc411951</serial>
Nov 14 22:23:01 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 22:23:01 user nova-compute[76815]: </disk>
Nov 14 22:23:01 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:23:01 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully detached device vdc from instance 85f255af-70de-47c0-bc23-e3957542b150 from the persistent domain config.
Nov 14 22:23:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 85f255af-70de-47c0-bc23-e3957542b150 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:23:01 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:23:01 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:23:01 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:23:01 user nova-compute[76815]:   <target dev="vdc" bus="virtio"/>
Nov 14 22:23:01 user nova-compute[76815]:   <serial>08922ff9-c725-420f-a531-09b0cc411951</serial>
Nov 14 22:23:01 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 22:23:01 user nova-compute[76815]: </disk>
Nov 14 22:23:01 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:23:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:23:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:03 user nova-compute[76815]: INFO nova.compute.manager [None req-f2b3b3b1-60ab-4d0d-aaf9-f89d7a77e6c2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Unrescuing
Nov 14 22:23:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f2b3b3b1-60ab-4d0d-aaf9-f89d7a77e6c2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:23:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f2b3b3b1-60ab-4d0d-aaf9-f89d7a77e6c2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquired lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:23:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f2b3b3b1-60ab-4d0d-aaf9-f89d7a77e6c2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:23:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f2b3b3b1-60ab-4d0d-aaf9-f89d7a77e6c2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating instance_info_cache with network_info: [{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:23:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f2b3b3b1-60ab-4d0d-aaf9-f89d7a77e6c2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Releasing lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:23:03 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f2b3b3b1-60ab-4d0d-aaf9-f89d7a77e6c2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'flavor' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-84849539-38ad-49a8-b3ca-e173ce7b98a4 req-8623b821-7fe3-4568-bcbc-db16f87d7198 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-unplugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-84849539-38ad-49a8-b3ca-e173ce7b98a4 req-8623b821-7fe3-4568-bcbc-db16f87d7198 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-84849539-38ad-49a8-b3ca-e173ce7b98a4 req-8623b821-7fe3-4568-bcbc-db16f87d7198 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-84849539-38ad-49a8-b3ca-e173ce7b98a4 req-8623b821-7fe3-4568-bcbc-db16f87d7198 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-84849539-38ad-49a8-b3ca-e173ce7b98a4 req-8623b821-7fe3-4568-bcbc-db16f87d7198 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-unplugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:23:04 user nova-compute[76815]: WARNING nova.compute.manager [req-84849539-38ad-49a8-b3ca-e173ce7b98a4 req-8623b821-7fe3-4568-bcbc-db16f87d7198 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-unplugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:23:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-8be07619-029d-489a-b66b-7d58c42a3c5a req-302f6b3a-b91e-43a9-9112-cbef645bf418 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-changed-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-8be07619-029d-489a-b66b-7d58c42a3c5a req-302f6b3a-b91e-43a9-9112-cbef645bf418 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Refreshing instance network info cache due to event network-changed-49dbd78d-299e-4717-bf85-1a3ad0e83689. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8be07619-029d-489a-b66b-7d58c42a3c5a req-302f6b3a-b91e-43a9-9112-cbef645bf418 service nova] Acquiring lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8be07619-029d-489a-b66b-7d58c42a3c5a req-302f6b3a-b91e-43a9-9112-cbef645bf418 service nova] Acquired lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-8be07619-029d-489a-b66b-7d58c42a3c5a req-302f6b3a-b91e-43a9-9112-cbef645bf418 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Refreshing network info cache for port 49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:23:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Instance destroyed successfully.
Nov 14 22:23:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-8be07619-029d-489a-b66b-7d58c42a3c5a req-302f6b3a-b91e-43a9-9112-cbef645bf418 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updated VIF entry in instance network info cache for port 49dbd78d-299e-4717-bf85-1a3ad0e83689. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:23:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-8be07619-029d-489a-b66b-7d58c42a3c5a req-302f6b3a-b91e-43a9-9112-cbef645bf418 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating instance_info_cache with network_info: [{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:23:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8be07619-029d-489a-b66b-7d58c42a3c5a req-302f6b3a-b91e-43a9-9112-cbef645bf418 service nova] Releasing lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-d4ace7b3-77c2-4171-8161-6b8a21f23192 req-77359281-79cc-4095-87c2-e46ea1a96d34 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d4ace7b3-77c2-4171-8161-6b8a21f23192 req-77359281-79cc-4095-87c2-e46ea1a96d34 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d4ace7b3-77c2-4171-8161-6b8a21f23192 req-77359281-79cc-4095-87c2-e46ea1a96d34 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d4ace7b3-77c2-4171-8161-6b8a21f23192 req-77359281-79cc-4095-87c2-e46ea1a96d34 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-d4ace7b3-77c2-4171-8161-6b8a21f23192 req-77359281-79cc-4095-87c2-e46ea1a96d34 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:23:06 user nova-compute[76815]: WARNING nova.compute.manager [req-d4ace7b3-77c2-4171-8161-6b8a21f23192 req-77359281-79cc-4095-87c2-e46ea1a96d34 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:23:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-06ec7a0f-b16d-4be2-ab0a-53a48ce36491 req-28434078-0eb3-4a3e-94dd-481c9950c3c4 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-changed-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-06ec7a0f-b16d-4be2-ab0a-53a48ce36491 req-28434078-0eb3-4a3e-94dd-481c9950c3c4 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Refreshing instance network info cache due to event network-changed-49dbd78d-299e-4717-bf85-1a3ad0e83689. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-06ec7a0f-b16d-4be2-ab0a-53a48ce36491 req-28434078-0eb3-4a3e-94dd-481c9950c3c4 service nova] Acquiring lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-06ec7a0f-b16d-4be2-ab0a-53a48ce36491 req-28434078-0eb3-4a3e-94dd-481c9950c3c4 service nova] Acquired lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-06ec7a0f-b16d-4be2-ab0a-53a48ce36491 req-28434078-0eb3-4a3e-94dd-481c9950c3c4 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Refreshing network info cache for port 49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:07 user nova-compute[76815]: DEBUG nova.network.neutron [req-06ec7a0f-b16d-4be2-ab0a-53a48ce36491 req-28434078-0eb3-4a3e-94dd-481c9950c3c4 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updated VIF entry in instance network info cache for port 49dbd78d-299e-4717-bf85-1a3ad0e83689. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:23:07 user nova-compute[76815]: DEBUG nova.network.neutron [req-06ec7a0f-b16d-4be2-ab0a-53a48ce36491 req-28434078-0eb3-4a3e-94dd-481c9950c3c4 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating instance_info_cache with network_info: [{"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:23:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-06ec7a0f-b16d-4be2-ab0a-53a48ce36491 req-28434078-0eb3-4a3e-94dd-481c9950c3c4 service nova] Releasing lock "refresh_cache-9e076b98-3f30-4a9a-aa97-330c748de261" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:23:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:23:08 user nova-compute[76815]: WARNING nova.compute.manager [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:23:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:23:08 user nova-compute[76815]: WARNING nova.compute.manager [req-d56243fc-1c00-472a-a493-0aad049ba26b req-c35f83f2-7dc1-4f2c-8af2-f1407420a9e0 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:23:08 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f2b3b3b1-60ab-4d0d-aaf9-f89d7a77e6c2 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:23:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:23:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:23:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:23:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:23:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:22 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 85f255af-70de-47c0-bc23-e3957542b150 is timed out.
Nov 14 22:23:22 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully detached device vdc from instance 85f255af-70de-47c0-bc23-e3957542b150 from the live domain config.
Nov 14 22:23:22 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KGDOYNFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:23:22 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd5bb1a-c2c2-45c8-887a-4f7c420b0968]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:23:22 user nova-compute[76815]: No targets found.
Nov 14 22:23:22 user nova-compute[76815]: iSNS:
Nov 14 22:23:22 user nova-compute[76815]: No targets found.
Nov 14 22:23:22 user nova-compute[76815]: STATIC:
Nov 14 22:23:22 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a
Nov 14 22:23:22 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:22 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:22 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:23:22 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:22 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:22 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44
Nov 14 22:23:22 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:22 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:22 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951
Nov 14 22:23:22 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:22 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:22 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c
Nov 14 22:23:22 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:22 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:22 user nova-compute[76815]: FIRMWARE:
Nov 14 22:23:22 user nova-compute[76815]: No targets found.
Nov 14 22:23:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:23:22 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:23:22 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[98023fe9-922e-44e2-820f-4991fef66206]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c0c10-fb08-4065-bddd-c25d42f0babb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:23:22 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:23:22 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:23:22 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:23:22 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:23:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:23:22 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:23:22 user nova-compute[76815]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 (non-flash)
Nov 14 22:23:22 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:23:22 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:23:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a45071c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7996e3-cde3-4b12-8e92-77f2449c298a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1419f16b-5828-4337-a4ad-c35f9fd87b75]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bfe042-2417-4b74-bf67-ee65d9126012]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bae142d-630a-4576-9cfe-130af32d3023]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1411315-330b-40a0-a99a-f4b722978522]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[75588160-afe4-4697-b917-8ee92cf5e159]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951, portal: 172.16.0.220,3260]
Nov 14 22:23:22 user nova-compute[76815]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951, portal: 172.16.0.220,3260] successful.
Nov 14 22:23:22 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08922ff9-c725-420f-a531-09b0cc411951 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce1cf88-89aa-49eb-84c7-11b5b9687372]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] <== disconnect_volume: return (289ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:23:22 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:23:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'flavor' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:23:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-125924ac-666a-439d-9e38-ea94b1d0cd8a tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.617s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-55bb3919-e19f-4ff7-8600-fc52b066091f req-e0be7335-1027-4509-9e0f-6fa525421e2e service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received event network-changed-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-55bb3919-e19f-4ff7-8600-fc52b066091f req-e0be7335-1027-4509-9e0f-6fa525421e2e service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Refreshing instance network info cache due to event network-changed-40a09f29-a223-4a6c-9491-e210fcc849d8. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55bb3919-e19f-4ff7-8600-fc52b066091f req-e0be7335-1027-4509-9e0f-6fa525421e2e service nova] Acquiring lock "refresh_cache-20dd4416-3dc0-4ca0-bca0-3cceafbb7925" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55bb3919-e19f-4ff7-8600-fc52b066091f req-e0be7335-1027-4509-9e0f-6fa525421e2e service nova] Acquired lock "refresh_cache-20dd4416-3dc0-4ca0-bca0-3cceafbb7925" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-55bb3919-e19f-4ff7-8600-fc52b066091f req-e0be7335-1027-4509-9e0f-6fa525421e2e service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Refreshing network info cache for port 40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:36 user nova-compute[76815]: INFO nova.compute.manager [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Detaching volume 53ebb970-e00b-458d-a558-407d4eac3d44
Nov 14 22:23:36 user nova-compute[76815]: INFO nova.virt.block_device [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Attempting to driver detach volume 53ebb970-e00b-458d-a558-407d4eac3d44 from mountpoint /dev/vdb
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Attempting to detach device vdb from instance 9e076b98-3f30-4a9a-aa97-330c748de261 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:23:36 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:23:36 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:23:36 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:23:36 user nova-compute[76815]:   <serial>53ebb970-e00b-458d-a558-407d4eac3d44</serial>
Nov 14 22:23:36 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:23:36 user nova-compute[76815]: </disk>
Nov 14 22:23:36 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:23:36 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Successfully detached device vdb from instance 9e076b98-3f30-4a9a-aa97-330c748de261 from the persistent domain config.
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e076b98-3f30-4a9a-aa97-330c748de261 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:23:36 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:23:36 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:23:36 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:23:36 user nova-compute[76815]:   <serial>53ebb970-e00b-458d-a558-407d4eac3d44</serial>
Nov 14 22:23:36 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:23:36 user nova-compute[76815]: </disk>
Nov 14 22:23:36 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-55bb3919-e19f-4ff7-8600-fc52b066091f req-e0be7335-1027-4509-9e0f-6fa525421e2e service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Updated VIF entry in instance network info cache for port 40a09f29-a223-4a6c-9491-e210fcc849d8. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-55bb3919-e19f-4ff7-8600-fc52b066091f req-e0be7335-1027-4509-9e0f-6fa525421e2e service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Updating instance_info_cache with network_info: [{"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55bb3919-e19f-4ff7-8600-fc52b066091f req-e0be7335-1027-4509-9e0f-6fa525421e2e service nova] Releasing lock "refresh_cache-20dd4416-3dc0-4ca0-bca0-3cceafbb7925" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:36 user nova-compute[76815]: INFO nova.compute.manager [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Terminating instance
Nov 14 22:23:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Instance destroyed successfully.
Nov 14 22:23:37 user nova-compute[76815]: DEBUG nova.objects.instance [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'resources' on Instance uuid 20dd4416-3dc0-4ca0-bca0-3cceafbb7925 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2096198901',display_name='tempest-TestVolumeBootPattern-server-2096198901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2096198901',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVEyUh19O0alKw62tv3KmxoqsN7lyGaF0+P2xIoHxT+cKRRBx4MW7gidGmxry5UdKm4qrUC1sXQJe9NOXzjEcpENxKgmVXT2xLtMcWY8QrB8wG3DfxFfdkpczVqlfoPA==',key_name='tempest-TestVolumeBootPattern-1688630530',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-8ohz02dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:21:55Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=20dd4416-3dc0-4ca0-bca0-3cceafbb7925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "40a09f29-a223-4a6c-9491-e210fcc849d8", "address": "fa:16:3e:42:3b:3f", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40a09f29-a2", "ovs_interfaceid": "40a09f29-a223-4a6c-9491-e210fcc849d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:3f,bridge_name='br-int',has_traffic_filtering=True,id=40a09f29-a223-4a6c-9491-e210fcc849d8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a09f29-a2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_vif [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:3f,bridge_name='br-int',has_traffic_filtering=True,id=40a09f29-a223-4a6c-9491-e210fcc849d8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a09f29-a2') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40a09f29-a2, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13711941-9c8e-4171-ae2e-614edd0bb081) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:37 user nova-compute[76815]: INFO os_vif [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:3b:3f,bridge_name='br-int',has_traffic_filtering=True,id=40a09f29-a223-4a6c-9491-e210fcc849d8,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40a09f29-a2')
Nov 14 22:23:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTaBkxLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:23:37 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4a9de2-488a-42e7-af10-62f615e79e58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:23:37 user nova-compute[76815]: No targets found.
Nov 14 22:23:37 user nova-compute[76815]: iSNS:
Nov 14 22:23:37 user nova-compute[76815]: No targets found.
Nov 14 22:23:37 user nova-compute[76815]: STATIC:
Nov 14 22:23:37 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a
Nov 14 22:23:37 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:37 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:37 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:23:37 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:37 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:37 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44
Nov 14 22:23:37 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:37 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:37 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c
Nov 14 22:23:37 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:37 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:37 user nova-compute[76815]: FIRMWARE:
Nov 14 22:23:37 user nova-compute[76815]: No targets found.
Nov 14 22:23:37 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:23:37 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:23:37 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5409a492-77e0-4c1a-a878-cb69a257b13b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2035d6-518d-454e-aed7-1292a6622f5c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:23:37 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:23:37 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:23:37 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:23:37 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:23:37 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:23:37 user nova-compute[76815]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:23:37 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:23:37 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8262320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a'): ({'sde'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Removing single pathed devices sde {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4069d425-0b7d-4594-967a-6f012bd341c3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0604538c-2585-433d-beac-5618dac0045d]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flushing IO for device /dev/sde {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28a429e-fd61-49aa-a288-6519d679b6c5]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96f678c-801e-4e5f-a27c-d23eafc9a61f]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23766356563356235', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bbd823fc', '/dev/disk/by-id/scsi-1SCST_BIObbd823fc-7f5ec5b57361007e') {{(pid=86648) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[12365997-ebef-4858-9a80-3f5e12cf2395]: (4, None) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb7578c-7149-4224-9951-d2c97357a735]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[009a8524-1533-4186-8128-375767b88d2d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260]
Nov 14 22:23:37 user nova-compute[76815]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260] successful.
Nov 14 22:23:37 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50599cf-7ae4-4220-9873-504e726a8512]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== disconnect_volume: return (307ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:23:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Deleting instance files /opt/stack/data/nova/instances/20dd4416-3dc0-4ca0-bca0-3cceafbb7925_del
Nov 14 22:23:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Deletion of /opt/stack/data/nova/instances/20dd4416-3dc0-4ca0-bca0-3cceafbb7925_del complete
Nov 14 22:23:37 user nova-compute[76815]: INFO nova.compute.manager [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 22:23:37 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:23:37 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received event network-vif-unplugged-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] Acquiring lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] No waiting events found dispatching network-vif-unplugged-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received event network-vif-unplugged-40a09f29-a223-4a6c-9491-e210fcc849d8 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received event network-vif-plugged-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] Acquiring lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] No waiting events found dispatching network-vif-plugged-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:23:38 user nova-compute[76815]: WARNING nova.compute.manager [req-ce5b2b74-d673-4ab8-85ab-4df71e0155d5 req-309fe5e4-a2d7-4a9f-b8e3-cbe209cb9bcd service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received unexpected event network-vif-plugged-40a09f29-a223-4a6c-9491-e210fcc849d8 for instance with vm_state active and task_state deleting.
Nov 14 22:23:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:39 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:23:39 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Took 1.24 seconds to deallocate network for instance.
Nov 14 22:23:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-59be78bf-beb8-4b8e-8088-10deb452cbdd req-b85bf9b9-dc13-4cb6-be17-2508b3d87cc0 service nova] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Received event network-vif-deleted-40a09f29-a223-4a6c-9491-e210fcc849d8 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:40 user nova-compute[76815]: INFO nova.compute.manager [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 20dd4416-3dc0-4ca0-bca0-3cceafbb7925] Took 0.81 seconds to detach 1 volumes for instance.
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:40 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Deleted allocations for instance 20dd4416-3dc0-4ca0-bca0-3cceafbb7925
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-16b7a544-1e57-4117-98c7-400bf3fc3f29 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "20dd4416-3dc0-4ca0-bca0-3cceafbb7925" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.939s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:23:42 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:23:42 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8248MB free_disk=24.929031372070312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 9e076b98-3f30-4a9a-aa97-330c748de261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 85f255af-70de-47c0-bc23-e3957542b150 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3d82c8bf-899a-4e18-9738-8b6d067867bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:23:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:43 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:43 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:23:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:23:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:23:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:23:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:23:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:23:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:23:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:48 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:51 user nova-compute[76815]: INFO nova.compute.manager [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Terminating instance
Nov 14 22:23:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:23:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-c59d8455-4f94-4d00-9e9f-80817aaf8112 req-1da0ab32-c745-4974-b83d-716340e04ffc service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-unplugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c59d8455-4f94-4d00-9e9f-80817aaf8112 req-1da0ab32-c745-4974-b83d-716340e04ffc service nova] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c59d8455-4f94-4d00-9e9f-80817aaf8112 req-1da0ab32-c745-4974-b83d-716340e04ffc service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c59d8455-4f94-4d00-9e9f-80817aaf8112 req-1da0ab32-c745-4974-b83d-716340e04ffc service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-c59d8455-4f94-4d00-9e9f-80817aaf8112 req-1da0ab32-c745-4974-b83d-716340e04ffc service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] No waiting events found dispatching network-vif-unplugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-c59d8455-4f94-4d00-9e9f-80817aaf8112 req-1da0ab32-c745-4974-b83d-716340e04ffc service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-unplugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:52 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Instance destroyed successfully.
Nov 14 22:23:52 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'resources' on Instance uuid 85f255af-70de-47c0-bc23-e3957542b150 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-196113391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-196113391',id=29,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbC3aWMQKKo3fu9/qMLPqaAgfQycwIfVXXScjuHVNwhIdPP2P5zysFD+owiLum7T2lUISKMNWqu3Slgqxg4DGxJvWuksE48UQeUJ9YCAbYcMSiT6OZRwFTcMeuHw+SIGQ==',key_name='tempest-keypair-24643289',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-gin1akfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=85f255af-70de-47c0-bc23-e3957542b150,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "address": "fa:16:3e:55:43:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a9c880b-50", "ovs_interfaceid": "6a9c880b-50a5-4606-9fe5-1e6ad5172aee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG os_vif [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a9c880b-50, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e468d27c-491d-4dfe-87d5-0b61c8222bda) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:52 user nova-compute[76815]: INFO os_vif [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:43:4f,bridge_name='br-int',has_traffic_filtering=True,id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a9c880b-50')
Nov 14 22:23:52 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Deleting instance files /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150_del
Nov 14 22:23:52 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Deletion of /opt/stack/data/nova/instances/85f255af-70de-47c0-bc23-e3957542b150_del complete
Nov 14 22:23:52 user nova-compute[76815]: INFO nova.compute.manager [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 22:23:52 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:23:52 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:23:53 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:23:53 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Took 0.63 seconds to deallocate network for instance.
Nov 14 22:23:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-7ed0c97d-4b15-45ad-a18d-6501f75ccb2a req-cddebdf7-9837-42e4-910f-3627b40cc14a service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-deleted-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:53 user nova-compute[76815]: INFO nova.compute.manager [req-7ed0c97d-4b15-45ad-a18d-6501f75ccb2a req-cddebdf7-9837-42e4-910f-3627b40cc14a service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Neutron deleted interface 6a9c880b-50a5-4606-9fe5-1e6ad5172aee; detaching it from the instance and deleting it from the info cache
Nov 14 22:23:53 user nova-compute[76815]: DEBUG nova.network.neutron [req-7ed0c97d-4b15-45ad-a18d-6501f75ccb2a req-cddebdf7-9837-42e4-910f-3627b40cc14a service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:23:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-7ed0c97d-4b15-45ad-a18d-6501f75ccb2a req-cddebdf7-9837-42e4-910f-3627b40cc14a service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Detach interface failed, port_id=6a9c880b-50a5-4606-9fe5-1e6ad5172aee, reason: Instance 85f255af-70de-47c0-bc23-e3957542b150 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:23:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:53 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:23:53 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:23:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:53 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Deleted allocations for instance 85f255af-70de-47c0-bc23-e3957542b150
Nov 14 22:23:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f4c17d08-de58-4888-81f4-90f02807d86c tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "85f255af-70de-47c0-bc23-e3957542b150" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-b255001c-2bb6-4693-b7d2-ad1cd5f8d24e req-935f3c82-21ba-4ccc-9b11-959ad325d500 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b255001c-2bb6-4693-b7d2-ad1cd5f8d24e req-935f3c82-21ba-4ccc-9b11-959ad325d500 service nova] Acquiring lock "85f255af-70de-47c0-bc23-e3957542b150-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b255001c-2bb6-4693-b7d2-ad1cd5f8d24e req-935f3c82-21ba-4ccc-9b11-959ad325d500 service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b255001c-2bb6-4693-b7d2-ad1cd5f8d24e req-935f3c82-21ba-4ccc-9b11-959ad325d500 service nova] Lock "85f255af-70de-47c0-bc23-e3957542b150-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-b255001c-2bb6-4693-b7d2-ad1cd5f8d24e req-935f3c82-21ba-4ccc-9b11-959ad325d500 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] No waiting events found dispatching network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:23:54 user nova-compute[76815]: WARNING nova.compute.manager [req-b255001c-2bb6-4693-b7d2-ad1cd5f8d24e req-935f3c82-21ba-4ccc-9b11-959ad325d500 service nova] [instance: 85f255af-70de-47c0-bc23-e3957542b150] Received unexpected event network-vif-plugged-6a9c880b-50a5-4606-9fe5-1e6ad5172aee for instance with vm_state deleted and task_state None.
Nov 14 22:23:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:23:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:23:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:23:56 user nova-compute[76815]: INFO nova.compute.claims [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Claim successful on node user
Nov 14 22:23:56 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG nova.network.neutron [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:23:56 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:23:56 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:23:56 user nova-compute[76815]: DEBUG nova.policy [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6ef0744ff3b459b9e32404ec12bbe55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327b9fb17cb74bb0a56380b0d084cec3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:23:56 user nova-compute[76815]: INFO nova.virt.block_device [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Booting with volume-backed-image 17f0b7df-7e07-48b3-bb67-6524172efa0a at /dev/vda
Nov 14 22:23:57 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e076b98-3f30-4a9a-aa97-330c748de261 is timed out.
Nov 14 22:23:57 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Successfully detached device vdb from instance 9e076b98-3f30-4a9a-aa97-330c748de261 from the live domain config.
Nov 14 22:23:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKeZslLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:23:57 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45a0510-f467-4181-b7ee-c4c169fc89b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:23:57 user nova-compute[76815]: No targets found.
Nov 14 22:23:57 user nova-compute[76815]: iSNS:
Nov 14 22:23:57 user nova-compute[76815]: No targets found.
Nov 14 22:23:57 user nova-compute[76815]: STATIC:
Nov 14 22:23:57 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:23:57 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:57 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:57 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44
Nov 14 22:23:57 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:57 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:57 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c
Nov 14 22:23:57 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:23:57 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:23:57 user nova-compute[76815]: FIRMWARE:
Nov 14 22:23:57 user nova-compute[76815]: No targets found.
Nov 14 22:23:57 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:23:57 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:23:57 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d88825-1966-442c-a652-9636960fdcd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG nova.network.neutron [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Successfully created port: f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[71971047-de08-4ba3-9b82-9b21984d1396]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:23:57 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:23:57 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:23:57 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:23:57 user nova-compute[76815]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 (non-flash)
Nov 14 22:23:57 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:23:57 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a47930a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba55e4d-f389-49d9-bf7b-8c681139820d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[393e7dec-f4b5-4000-a345-19adda584a48]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9436d58c-c5dc-4d0d-8dd3-da8a3bd40a86]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[22497257-8e63-496b-ba9e-f3f7eb23d38c]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[19971ebd-54cc-465e-9bb4-3278a0f4dab3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0607018-5652-4435-a778-1bb966fc5c60]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44, portal: 172.16.0.220,3260]
Nov 14 22:23:57 user nova-compute[76815]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44, portal: 172.16.0.220,3260] successful.
Nov 14 22:23:57 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ebb970-e00b-458d-a558-407d4eac3d44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[659f81fc-6442-4464-b2b5-d228391404e2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] <== disconnect_volume: return (317ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG nova.network.neutron [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Successfully updated port: f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquired lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG nova.network.neutron [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-519e1f2e-e118-4785-bb05-dc3705e3af27 req-cf10e362-a3c9-4b17-a3b6-20ad8b614683 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-changed-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-519e1f2e-e118-4785-bb05-dc3705e3af27 req-cf10e362-a3c9-4b17-a3b6-20ad8b614683 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Refreshing instance network info cache due to event network-changed-f2cbfde8-95a0-4602-9b7a-bb86e213a377. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-519e1f2e-e118-4785-bb05-dc3705e3af27 req-cf10e362-a3c9-4b17-a3b6-20ad8b614683 service nova] Acquiring lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:23:57 user nova-compute[76815]: DEBUG nova.network.neutron [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updating instance_info_cache with network_info: [{"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG nova.objects.instance [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'flavor' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Releasing lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Instance network_info: |[{"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-519e1f2e-e118-4785-bb05-dc3705e3af27 req-cf10e362-a3c9-4b17-a3b6-20ad8b614683 service nova] Acquired lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG nova.network.neutron [req-519e1f2e-e118-4785-bb05-dc3705e3af27 req-cf10e362-a3c9-4b17-a3b6-20ad8b614683 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Refreshing network info cache for port f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-59e4c7ce-d163-49cb-a75a-d265ced84399 tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG nova.network.neutron [req-519e1f2e-e118-4785-bb05-dc3705e3af27 req-cf10e362-a3c9-4b17-a3b6-20ad8b614683 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updated VIF entry in instance network info cache for port f2cbfde8-95a0-4602-9b7a-bb86e213a377. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG nova.network.neutron [req-519e1f2e-e118-4785-bb05-dc3705e3af27 req-cf10e362-a3c9-4b17-a3b6-20ad8b614683 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updating instance_info_cache with network_info: [{"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:23:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-519e1f2e-e118-4785-bb05-dc3705e3af27 req-cf10e362-a3c9-4b17-a3b6-20ad8b614683 service nova] Releasing lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG os_brick.utils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd721b-2970-4a1c-b5e9-f0851b29b8a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b23df2-d387-45ee-a952-c1f6282d336f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbdebfb-3fac-4199-834c-3d35c092933e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6309db4e-72ed-4690-b991-372f53a3e749]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:24:02 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:24:02 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bee52d-fb58-4c62-a83a-0ecb621bd831]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG os_brick.utils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updating existing volume attachment record: b0937b20-4df3-4bfa-a2eb-1bfdcd6ccffd {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:24:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-f60d2004-15c8-4dcb-8bdf-cdc04b4defd3 req-1ab742f4-b760-42c0-8827-9051dba94046 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received event network-changed-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-f60d2004-15c8-4dcb-8bdf-cdc04b4defd3 req-1ab742f4-b760-42c0-8827-9051dba94046 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Refreshing instance network info cache due to event network-changed-dc5e49f0-2f7c-4750-86ab-270834c97d82. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:24:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f60d2004-15c8-4dcb-8bdf-cdc04b4defd3 req-1ab742f4-b760-42c0-8827-9051dba94046 service nova] Acquiring lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:24:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f60d2004-15c8-4dcb-8bdf-cdc04b4defd3 req-1ab742f4-b760-42c0-8827-9051dba94046 service nova] Acquired lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:24:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-f60d2004-15c8-4dcb-8bdf-cdc04b4defd3 req-1ab742f4-b760-42c0-8827-9051dba94046 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Refreshing network info cache for port dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:24:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-f60d2004-15c8-4dcb-8bdf-cdc04b4defd3 req-1ab742f4-b760-42c0-8827-9051dba94046 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updated VIF entry in instance network info cache for port dc5e49f0-2f7c-4750-86ab-270834c97d82. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:24:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-f60d2004-15c8-4dcb-8bdf-cdc04b4defd3 req-1ab742f4-b760-42c0-8827-9051dba94046 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updating instance_info_cache with network_info: [{"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f60d2004-15c8-4dcb-8bdf-cdc04b4defd3 req-1ab742f4-b760-42c0-8827-9051dba94046 service nova] Releasing lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Stashing vm_state: active {{(pid=76815) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 22:24:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:24:05 user nova-compute[76815]: INFO nova.compute.claims [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Claim successful on node user
Nov 14 22:24:05 user nova-compute[76815]: INFO nova.compute.resource_tracker [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating resource usage from migration 3b7a8642-d37b-4073-b59c-4157768f0cea
Nov 14 22:24:05 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:24:05 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:24:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.323s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:05 user nova-compute[76815]: INFO nova.compute.manager [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Migrating
Nov 14 22:24:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:24:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquired lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:24:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.network.neutron [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating instance_info_cache with network_info: [{"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-9dd7f4a5-b40f-4fff-89a5-0db89b0459e0 req-53d9b4fc-27c7-4061-93a1-59647eeaf4cd service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-changed-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-9dd7f4a5-b40f-4fff-89a5-0db89b0459e0 req-53d9b4fc-27c7-4061-93a1-59647eeaf4cd service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Refreshing instance network info cache due to event network-changed-25c739be-c20c-4d5a-885e-ef0ad796a1fe. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9dd7f4a5-b40f-4fff-89a5-0db89b0459e0 req-53d9b4fc-27c7-4061-93a1-59647eeaf4cd service nova] Acquiring lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Releasing lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9dd7f4a5-b40f-4fff-89a5-0db89b0459e0 req-53d9b4fc-27c7-4061-93a1-59647eeaf4cd service nova] Acquired lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-9dd7f4a5-b40f-4fff-89a5-0db89b0459e0 req-53d9b4fc-27c7-4061-93a1-59647eeaf4cd service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Refreshing network info cache for port 25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Starting migrate_disk_and_power_off {{(pid=76815) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-9dd7f4a5-b40f-4fff-89a5-0db89b0459e0 req-53d9b4fc-27c7-4061-93a1-59647eeaf4cd service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updated VIF entry in instance network info cache for port 25c739be-c20c-4d5a-885e-ef0ad796a1fe. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-9dd7f4a5-b40f-4fff-89a5-0db89b0459e0 req-53d9b4fc-27c7-4061-93a1-59647eeaf4cd service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating instance_info_cache with network_info: [{"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9dd7f4a5-b40f-4fff-89a5-0db89b0459e0 req-53d9b4fc-27c7-4061-93a1-59647eeaf4cd service nova] Releasing lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:06 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Instance destroyed successfully.
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1598603901',display_name='tempest-ServerActionsTestOtherA-server-1598603901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1598603901',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVfME04PD9rglznppi8Ho3+jsumiOYFPtvR+yy+S2ej5C5M3kJOl8pyG4taHWLiqRqGcIU6SfKKWEu+JVsdH1FsdhxYcOosylxiuo+4fsZkdlqozg87LpEdVgLP6QXNw==',key_name='tempest-keypair-1998197341',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-ojj0ei0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=3d82c8bf-899a-4e18-9738-8b6d067867bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1188991552-network", "vif_mac": "fa:16:3e:6c:92:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1188991552-network", "vif_mac": "fa:16:3e:6c:92:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG os_vif [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25c739be-c2, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9452669-7e5c-4f5d-bdb9-0f8ab5601ee3) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:07 user nova-compute[76815]: INFO os_vif [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2')
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRQLWaPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:24:07 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4025654e-fc75-4995-b745-73364e10fb80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:24:07 user nova-compute[76815]: No targets found.
Nov 14 22:24:07 user nova-compute[76815]: iSNS:
Nov 14 22:24:07 user nova-compute[76815]: No targets found.
Nov 14 22:24:07 user nova-compute[76815]: STATIC:
Nov 14 22:24:07 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:24:07 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:24:07 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:24:07 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c
Nov 14 22:24:07 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:24:07 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:24:07 user nova-compute[76815]: FIRMWARE:
Nov 14 22:24:07 user nova-compute[76815]: No targets found.
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:24:07 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:24:07 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0668115-5e0d-4fbe-a375-8afafe8088dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd1f008-9f01-43a1-93b3-bc2dad6637a1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:07 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:07 user nova-compute[76815]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a43fd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c'): ({'sdf'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Removing single pathed devices sdf {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[01501e09-dad3-44d2-a3a2-b06db7953d5b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[94699eab-c09a-4999-b86b-3785650b2e54]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flushing IO for device /dev/sdf {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:24:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Creating image(s)
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Ensure instance console log exists: /opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Start _get_guest_xml network_info=[{"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQZdafv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bf4d919-7b71-4a01-8f73-f23f5ba76526', 'attached_at': '', 'detached_at': '', 'volume_id': 'b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 'serial': 'b322f8f6-b262-4a1d-a26a-e74aa9ee748a'}, 'attachment_id': 'b0937b20-4df3-4bfa-a2eb-1bfdcd6ccffd', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[763b9469-0b51-45c8-ac95-c7fd52bb7543]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:24:07 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:07 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQZdafv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:24:07 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2a5b7e-513e-4558-aa1d-dfd5f38437ef]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[70508260-0049-4ffc-a4ed-6f3562c54b91]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca23124-eac4-414a-9cb4-23fdf3f6da5c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260]
Nov 14 22:24:07 user nova-compute[76815]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260] successful.
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0f975b-c1a2-47a9-b1c4-5c74b94cc883]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== disconnect_volume: return (313ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.122s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:24:07 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:24:07 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc1a5bc-fca1-4327-abb0-f62e2de0b563]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:24:07 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e56772-c545-45f4-bcfc-1c473dc672ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a] added
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a34f4d0-72cc-444a-a873-ca44e919361c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeedbe9-a669-46c0-8257-35d8c40294a9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUQZdafv {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUQZdafv" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bed38ce-9871-45fa-96f5-7e76d99b45c4]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eUQZdafv'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5ebb4-2466-475b-a136-c8fa1d4ea679]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b385de-d6a7-41a3-b930-d6e7efb60c66]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a715def5-f229-49fd-886c-adfae8422d68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a, portal: 172.16.0.220,3260]
Nov 14 22:24:07 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a, portal: 172.16.0.220,3260] successful.
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92539e2-14eb-4af0-8483-b168e83d067a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cf78c0-0fe3-4a87-848b-daf3034abbc7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:07 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:07 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8562a8d-4546-4359-a677-125c513a4fd8]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:24:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQZdafv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-unplugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] No waiting events found dispatching network-vif-unplugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:08 user nova-compute[76815]: WARNING nova.compute.manager [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received unexpected event network-vif-unplugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe for instance with vm_state active and task_state resize_migrating.
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] No waiting events found dispatching network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:08 user nova-compute[76815]: WARNING nova.compute.manager [req-65ef1580-7cda-4d19-809d-9f508b215fd6 req-dc040ea7-530d-4e3d-8433-685f34c7fc5d service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received unexpected event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe for instance with vm_state active and task_state resize_migrating.
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.network.neutron [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Port 25c739be-c20c-4d5a-885e-ef0ad796a1fe binding to destination host user is already ACTIVE {{(pid=76815) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquired lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.network.neutron [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23532303665366331', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532303665366331', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1524441459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1524441459',id=34,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-sahpvd6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:23:57Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=6bf4d919-7b71-4a01-8f73-f23f5ba76526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=f2cbfde8-95a0-4602-9b7a-bb86e213a377,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cbfde8-95') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.objects.instance [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:24:08 user nova-compute[76815]:   <uuid>6bf4d919-7b71-4a01-8f73-f23f5ba76526</uuid>
Nov 14 22:24:08 user nova-compute[76815]:   <name>instance-00000022</name>
Nov 14 22:24:08 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:24:08 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:24:08 user nova-compute[76815]:   <metadata>
Nov 14 22:24:08 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:24:08 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:24:08 user nova-compute[76815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1524441459</nova:name>
Nov 14 22:24:08 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:24:07</nova:creationTime>
Nov 14 22:24:08 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:24:08 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:24:08 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:24:08 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:24:08 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:24:08 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:24:08 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:24:08 user nova-compute[76815]:       <nova:owner>
Nov 14 22:24:08 user nova-compute[76815]:         <nova:user uuid="a6ef0744ff3b459b9e32404ec12bbe55">tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member</nova:user>
Nov 14 22:24:08 user nova-compute[76815]:         <nova:project uuid="327b9fb17cb74bb0a56380b0d084cec3">tempest-ServerBootFromVolumeStableRescueTest-890378304</nova:project>
Nov 14 22:24:08 user nova-compute[76815]:       </nova:owner>
Nov 14 22:24:08 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:24:08 user nova-compute[76815]:       <nova:ports>
Nov 14 22:24:08 user nova-compute[76815]:         <nova:port uuid="f2cbfde8-95a0-4602-9b7a-bb86e213a377">
Nov 14 22:24:08 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:24:08 user nova-compute[76815]:         </nova:port>
Nov 14 22:24:08 user nova-compute[76815]:       </nova:ports>
Nov 14 22:24:08 user nova-compute[76815]:     </nova:instance>
Nov 14 22:24:08 user nova-compute[76815]:   </metadata>
Nov 14 22:24:08 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:24:08 user nova-compute[76815]:     <system>
Nov 14 22:24:08 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:24:08 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:24:08 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:24:08 user nova-compute[76815]:       <entry name="serial">6bf4d919-7b71-4a01-8f73-f23f5ba76526</entry>
Nov 14 22:24:08 user nova-compute[76815]:       <entry name="uuid">6bf4d919-7b71-4a01-8f73-f23f5ba76526</entry>
Nov 14 22:24:08 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:24:08 user nova-compute[76815]:     </system>
Nov 14 22:24:08 user nova-compute[76815]:   </sysinfo>
Nov 14 22:24:08 user nova-compute[76815]:   <os>
Nov 14 22:24:08 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:24:08 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:24:08 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:24:08 user nova-compute[76815]:   </os>
Nov 14 22:24:08 user nova-compute[76815]:   <features>
Nov 14 22:24:08 user nova-compute[76815]:     <acpi/>
Nov 14 22:24:08 user nova-compute[76815]:     <apic/>
Nov 14 22:24:08 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:24:08 user nova-compute[76815]:   </features>
Nov 14 22:24:08 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:24:08 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:24:08 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:24:08 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:24:08 user nova-compute[76815]:   </clock>
Nov 14 22:24:08 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:24:08 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:24:08 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:24:08 user nova-compute[76815]:   </cpu>
Nov 14 22:24:08 user nova-compute[76815]:   <devices>
Nov 14 22:24:08 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:24:08 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:24:08 user nova-compute[76815]:       <source dev="/dev/sdb"/>
Nov 14 22:24:08 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:24:08 user nova-compute[76815]:       <serial>b322f8f6-b262-4a1d-a26a-e74aa9ee748a</serial>
Nov 14 22:24:08 user nova-compute[76815]:     </disk>
Nov 14 22:24:08 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:24:08 user nova-compute[76815]:       <mac address="fa:16:3e:82:15:5a"/>
Nov 14 22:24:08 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:24:08 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:24:08 user nova-compute[76815]:       <target dev="tapf2cbfde8-95"/>
Nov 14 22:24:08 user nova-compute[76815]:     </interface>
Nov 14 22:24:08 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:24:08 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/console.log" append="off"/>
Nov 14 22:24:08 user nova-compute[76815]:     </serial>
Nov 14 22:24:08 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:24:08 user nova-compute[76815]:     <video>
Nov 14 22:24:08 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:24:08 user nova-compute[76815]:     </video>
Nov 14 22:24:08 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:24:08 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:24:08 user nova-compute[76815]:     </rng>
Nov 14 22:24:08 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:24:08 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:24:08 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:24:08 user nova-compute[76815]:     </memballoon>
Nov 14 22:24:08 user nova-compute[76815]:   </devices>
Nov 14 22:24:08 user nova-compute[76815]: </domain>
Nov 14 22:24:08 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1524441459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1524441459',id=34,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-sahpvd6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:23:57Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=6bf4d919-7b71-4a01-8f73-f23f5ba76526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=f2cbfde8-95a0-4602-9b7a-bb86e213a377,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cbfde8-95') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG os_vif [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=f2cbfde8-95a0-4602-9b7a-bb86e213a377,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cbfde8-95') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eea7781d-de3c-5194-afa8-ae594bb59031', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2cbfde8-95, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2cbfde8-95, col_values=(('qos', UUID('5fda472e-01c1-4b26-840a-c7d245e5b668')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2cbfde8-95, col_values=(('external_ids', {'iface-id': 'f2cbfde8-95a0-4602-9b7a-bb86e213a377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:15:5a', 'vm-uuid': '6bf4d919-7b71-4a01-8f73-f23f5ba76526'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:08 user nova-compute[76815]: INFO os_vif [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=f2cbfde8-95a0-4602-9b7a-bb86e213a377,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cbfde8-95')
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No VIF found with MAC fa:16:3e:82:15:5a, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG nova.network.neutron [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating instance_info_cache with network_info: [{"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Releasing lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG os_brick.utils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcc45aa-a43c-4947-9e45-2188c34b01b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e63c9d-2576-4cf4-8cd0-d300a62e1657]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b246377-173a-4484-a974-e4b30d7121b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bac0d32-1fc9-4333-a984-939d625c9ed8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:24:09 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:24:09 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd0b309-c251-463e-9dd8-26a0509406b5]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG os_brick.utils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-ab830345-f6d9-422d-8be9-d2ae9e42b759 req-3ae1835d-a64c-4fb5-982d-0d196a20a15a service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ab830345-f6d9-422d-8be9-d2ae9e42b759 req-3ae1835d-a64c-4fb5-982d-0d196a20a15a service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ab830345-f6d9-422d-8be9-d2ae9e42b759 req-3ae1835d-a64c-4fb5-982d-0d196a20a15a service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ab830345-f6d9-422d-8be9-d2ae9e42b759 req-3ae1835d-a64c-4fb5-982d-0d196a20a15a service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-ab830345-f6d9-422d-8be9-d2ae9e42b759 req-3ae1835d-a64c-4fb5-982d-0d196a20a15a service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:10 user nova-compute[76815]: WARNING nova.compute.manager [req-ab830345-f6d9-422d-8be9-d2ae9e42b759 req-3ae1835d-a64c-4fb5-982d-0d196a20a15a service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state building and task_state spawning.
Nov 14 22:24:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:24:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:24:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Instance spawned successfully.
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:12 user nova-compute[76815]: INFO nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-396062ee-9e12-4434-a8b0-adbfbf1c0aa8 req-9c524bf3-2be1-40c1-b5e3-32da1ae80af3 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-396062ee-9e12-4434-a8b0-adbfbf1c0aa8 req-9c524bf3-2be1-40c1-b5e3-32da1ae80af3 service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-396062ee-9e12-4434-a8b0-adbfbf1c0aa8 req-9c524bf3-2be1-40c1-b5e3-32da1ae80af3 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-396062ee-9e12-4434-a8b0-adbfbf1c0aa8 req-9c524bf3-2be1-40c1-b5e3-32da1ae80af3 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-396062ee-9e12-4434-a8b0-adbfbf1c0aa8 req-9c524bf3-2be1-40c1-b5e3-32da1ae80af3 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:12 user nova-compute[76815]: WARNING nova.compute.manager [req-396062ee-9e12-4434-a8b0-adbfbf1c0aa8 req-9c524bf3-2be1-40c1-b5e3-32da1ae80af3 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state building and task_state spawning.
Nov 14 22:24:12 user nova-compute[76815]: INFO nova.compute.manager [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Took 16.02 seconds to build instance.
Nov 14 22:24:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9447db2b-d50a-4ccc-8ddc-e1c8c1527fa0 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.148s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Starting finish_migration {{(pid=76815) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Instance directory exists: not creating {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 22:24:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Creating image(s)
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Ensure instance console log exists: /opt/stack/data/nova/instances/3d82c8bf-899a-4e18-9738-8b6d067867bf/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Start _get_guest_xml network_info=[{"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1188991552-network", "vif_mac": "fa:16:3e:6c:92:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRQLWaPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3d82c8bf-899a-4e18-9738-8b6d067867bf', 'attached_at': '2023-11-14T22:24:13.000000', 'detached_at': '', 'volume_id': 'ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'serial': 'ee8f1159-f512-44d0-aa1e-ef39e3880c8c'}, 'attachment_id': 'c10d7180-14c2-4661-84be-b4e97f6f0966', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:24:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:43Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRQLWaPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:24:13 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:24:13 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:24:13 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d4dc02-b393-47c0-a8f8-055b5db481d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:24:13 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcaddc0-c69b-4c26-b0be-1211cfdd00fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c] added
Nov 14 22:24:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ebaa91-d1dc-43fe-96ec-5a37631e28a9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[30931614-570c-40fb-b372-65d9fccb552d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fRQLWaPN {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fRQLWaPN" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dccff97-8040-46cf-883b-aef5fb2a7d03]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fRQLWaPN'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d4e2bb-8438-489f-92e4-9c472dc890e9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e60a3e-4119-4c25-b511-bc98c68dbee2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:13 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:13 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a963a2da-d86d-4081-ad7a-16bd07b80d49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260]
Nov 14 22:24:13 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260] successful.
Nov 14 22:24:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f7fb1d-5cc3-4d61-9d5e-09ec5cdf553a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b7d8dc-a2b4-4a63-addb-edd0b5c4f74f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:13 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:13 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:24:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:13 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:13 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:24:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b07d2c7-c710-48db-ace9-8ae51d897406]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:13 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRQLWaPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23630306465316231', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630306465316231', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1598603901',display_name='tempest-ServerActionsTestOtherA-server-1598603901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1598603901',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVfME04PD9rglznppi8Ho3+jsumiOYFPtvR+yy+S2ej5C5M3kJOl8pyG4taHWLiqRqGcIU6SfKKWEu+JVsdH1FsdhxYcOosylxiuo+4fsZkdlqozg87LpEdVgLP6QXNw==',key_name='tempest-keypair-1998197341',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-ojj0ei0n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:24:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=3d82c8bf-899a-4e18-9738-8b6d067867bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1188991552-network", "vif_mac": "fa:16:3e:6c:92:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1188991552-network", "vif_mac": "fa:16:3e:6c:92:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:24:14 user nova-compute[76815]:   <uuid>3d82c8bf-899a-4e18-9738-8b6d067867bf</uuid>
Nov 14 22:24:14 user nova-compute[76815]:   <name>instance-00000021</name>
Nov 14 22:24:14 user nova-compute[76815]:   <memory>2097152</memory>
Nov 14 22:24:14 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:24:14 user nova-compute[76815]:   <metadata>
Nov 14 22:24:14 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:24:14 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:24:14 user nova-compute[76815]:       <nova:name>tempest-ServerActionsTestOtherA-server-1598603901</nova:name>
Nov 14 22:24:14 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:24:13</nova:creationTime>
Nov 14 22:24:14 user nova-compute[76815]:       <nova:flavor name="m1.small">
Nov 14 22:24:14 user nova-compute[76815]:         <nova:memory>2048</nova:memory>
Nov 14 22:24:14 user nova-compute[76815]:         <nova:disk>20</nova:disk>
Nov 14 22:24:14 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:24:14 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:24:14 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:24:14 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:24:14 user nova-compute[76815]:       <nova:owner>
Nov 14 22:24:14 user nova-compute[76815]:         <nova:user uuid="85a900897f3a42bd89f966f4b7e253f6">tempest-ServerActionsTestOtherA-2016206168-project-member</nova:user>
Nov 14 22:24:14 user nova-compute[76815]:         <nova:project uuid="60b7e88b0ec54c5b9f15ae859e8c3984">tempest-ServerActionsTestOtherA-2016206168</nova:project>
Nov 14 22:24:14 user nova-compute[76815]:       </nova:owner>
Nov 14 22:24:14 user nova-compute[76815]:       <nova:ports>
Nov 14 22:24:14 user nova-compute[76815]:         <nova:port uuid="25c739be-c20c-4d5a-885e-ef0ad796a1fe">
Nov 14 22:24:14 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 22:24:14 user nova-compute[76815]:         </nova:port>
Nov 14 22:24:14 user nova-compute[76815]:       </nova:ports>
Nov 14 22:24:14 user nova-compute[76815]:     </nova:instance>
Nov 14 22:24:14 user nova-compute[76815]:   </metadata>
Nov 14 22:24:14 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:24:14 user nova-compute[76815]:     <system>
Nov 14 22:24:14 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:24:14 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:24:14 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:24:14 user nova-compute[76815]:       <entry name="serial">3d82c8bf-899a-4e18-9738-8b6d067867bf</entry>
Nov 14 22:24:14 user nova-compute[76815]:       <entry name="uuid">3d82c8bf-899a-4e18-9738-8b6d067867bf</entry>
Nov 14 22:24:14 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:24:14 user nova-compute[76815]:     </system>
Nov 14 22:24:14 user nova-compute[76815]:   </sysinfo>
Nov 14 22:24:14 user nova-compute[76815]:   <os>
Nov 14 22:24:14 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:24:14 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:24:14 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:24:14 user nova-compute[76815]:   </os>
Nov 14 22:24:14 user nova-compute[76815]:   <features>
Nov 14 22:24:14 user nova-compute[76815]:     <acpi/>
Nov 14 22:24:14 user nova-compute[76815]:     <apic/>
Nov 14 22:24:14 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:24:14 user nova-compute[76815]:   </features>
Nov 14 22:24:14 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:24:14 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:24:14 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:24:14 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:24:14 user nova-compute[76815]:   </clock>
Nov 14 22:24:14 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:24:14 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:24:14 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:24:14 user nova-compute[76815]:   </cpu>
Nov 14 22:24:14 user nova-compute[76815]:   <devices>
Nov 14 22:24:14 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:24:14 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:24:14 user nova-compute[76815]:       <source dev="/dev/sdc"/>
Nov 14 22:24:14 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:24:14 user nova-compute[76815]:       <serial>ee8f1159-f512-44d0-aa1e-ef39e3880c8c</serial>
Nov 14 22:24:14 user nova-compute[76815]:     </disk>
Nov 14 22:24:14 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:24:14 user nova-compute[76815]:       <mac address="fa:16:3e:6c:92:d9"/>
Nov 14 22:24:14 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:24:14 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:24:14 user nova-compute[76815]:       <target dev="tap25c739be-c2"/>
Nov 14 22:24:14 user nova-compute[76815]:     </interface>
Nov 14 22:24:14 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:24:14 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/3d82c8bf-899a-4e18-9738-8b6d067867bf/console.log" append="off"/>
Nov 14 22:24:14 user nova-compute[76815]:     </serial>
Nov 14 22:24:14 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:24:14 user nova-compute[76815]:     <video>
Nov 14 22:24:14 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:24:14 user nova-compute[76815]:     </video>
Nov 14 22:24:14 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:24:14 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:24:14 user nova-compute[76815]:     </rng>
Nov 14 22:24:14 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:24:14 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:24:14 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:24:14 user nova-compute[76815]:     </memballoon>
Nov 14 22:24:14 user nova-compute[76815]:   </devices>
Nov 14 22:24:14 user nova-compute[76815]: </domain>
Nov 14 22:24:14 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1598603901',display_name='tempest-ServerActionsTestOtherA-server-1598603901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1598603901',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVfME04PD9rglznppi8Ho3+jsumiOYFPtvR+yy+S2ej5C5M3kJOl8pyG4taHWLiqRqGcIU6SfKKWEu+JVsdH1FsdhxYcOosylxiuo+4fsZkdlqozg87LpEdVgLP6QXNw==',key_name='tempest-keypair-1998197341',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:22:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-ojj0ei0n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:24:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=3d82c8bf-899a-4e18-9738-8b6d067867bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1188991552-network", "vif_mac": "fa:16:3e:6c:92:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1188991552-network", "vif_mac": "fa:16:3e:6c:92:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG os_vif [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e391469e-449c-54da-a290-4ef3df4941ef', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25c739be-c2, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25c739be-c2, col_values=(('qos', UUID('c253c3f1-cf0c-4795-ba1d-a563ebd9e2bf')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25c739be-c2, col_values=(('external_ids', {'iface-id': '25c739be-c20c-4d5a-885e-ef0ad796a1fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:92:d9', 'vm-uuid': '3d82c8bf-899a-4e18-9738-8b6d067867bf'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:14 user nova-compute[76815]: INFO os_vif [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2')
Nov 14 22:24:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:24:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] No VIF found with MAC fa:16:3e:6c:92:d9, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:24:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-dde9bebb-e10c-48c0-aa84-5633b139a918 req-18f36a53-d418-49f7-8ab7-aebfa493cde6 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-dde9bebb-e10c-48c0-aa84-5633b139a918 req-18f36a53-d418-49f7-8ab7-aebfa493cde6 service nova] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-dde9bebb-e10c-48c0-aa84-5633b139a918 req-18f36a53-d418-49f7-8ab7-aebfa493cde6 service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-dde9bebb-e10c-48c0-aa84-5633b139a918 req-18f36a53-d418-49f7-8ab7-aebfa493cde6 service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-dde9bebb-e10c-48c0-aa84-5633b139a918 req-18f36a53-d418-49f7-8ab7-aebfa493cde6 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] No waiting events found dispatching network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:16 user nova-compute[76815]: WARNING nova.compute.manager [req-dde9bebb-e10c-48c0-aa84-5633b139a918 req-18f36a53-d418-49f7-8ab7-aebfa493cde6 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received unexpected event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe for instance with vm_state active and task_state resize_finish.
Nov 14 22:24:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:24:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Instance running successfully.
Nov 14 22:24:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Failed to set time: agent not configured {{(pid=76815) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 22:24:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dfdbcdab-c2fc-49eb-8025-67accf7c6ec7 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] finish_migration finished successfully. {{(pid=76815) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 22:24:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-55d43ba7-354b-4c60-bffb-6c9e4ed67774 req-8773d3c2-7ffd-42e0-bb82-919c48a2c923 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55d43ba7-354b-4c60-bffb-6c9e4ed67774 req-8773d3c2-7ffd-42e0-bb82-919c48a2c923 service nova] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55d43ba7-354b-4c60-bffb-6c9e4ed67774 req-8773d3c2-7ffd-42e0-bb82-919c48a2c923 service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55d43ba7-354b-4c60-bffb-6c9e4ed67774 req-8773d3c2-7ffd-42e0-bb82-919c48a2c923 service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-55d43ba7-354b-4c60-bffb-6c9e4ed67774 req-8773d3c2-7ffd-42e0-bb82-919c48a2c923 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] No waiting events found dispatching network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:18 user nova-compute[76815]: WARNING nova.compute.manager [req-55d43ba7-354b-4c60-bffb-6c9e4ed67774 req-8773d3c2-7ffd-42e0-bb82-919c48a2c923 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received unexpected event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe for instance with vm_state active and task_state resize_finish.
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_power_states {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid a8bb243d-ad93-47ae-8fbe-b5845a29496d {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 065c90e1-2099-4446-a998-de681bedf500 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 3d82c8bf-899a-4e18-9738-8b6d067867bf {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "065c90e1-2099-4446-a998-de681bedf500" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "065c90e1-2099-4446-a998-de681bedf500" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "065c90e1-2099-4446-a998-de681bedf500" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:27 user nova-compute[76815]: INFO nova.compute.manager [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Terminating instance
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-f7bcc202-d603-48b6-a8bd-fff8aceb9ab8 req-2d0e9ba6-d18a-4ea5-b356-cd5ac5cc0a1c service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-unplugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7bcc202-d603-48b6-a8bd-fff8aceb9ab8 req-2d0e9ba6-d18a-4ea5-b356-cd5ac5cc0a1c service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7bcc202-d603-48b6-a8bd-fff8aceb9ab8 req-2d0e9ba6-d18a-4ea5-b356-cd5ac5cc0a1c service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7bcc202-d603-48b6-a8bd-fff8aceb9ab8 req-2d0e9ba6-d18a-4ea5-b356-cd5ac5cc0a1c service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-f7bcc202-d603-48b6-a8bd-fff8aceb9ab8 req-2d0e9ba6-d18a-4ea5-b356-cd5ac5cc0a1c service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-unplugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-f7bcc202-d603-48b6-a8bd-fff8aceb9ab8 req-2d0e9ba6-d18a-4ea5-b356-cd5ac5cc0a1c service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-unplugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:24:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Instance destroyed successfully.
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.objects.instance [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lazy-loading 'resources' on Instance uuid 9e076b98-3f30-4a9a-aa97-330c748de261 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-937618737',display_name='tempest-ServerStableDeviceRescueTest-server-937618737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-937618737',id=28,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWjtV2c/oN0301FEraICGTVYdbwbdy/i7FSijB+CWm60Jph5H7nN7/o3v3XNaCNyM78hIA8LoU0m7Ji2TCjnVhzdkcmyOVBftbTg185VLlZCVEf5p00+5nZc7auPqUF2Q==',key_name='tempest-keypair-492100224',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be1bdb986de2488da17a7f44b6bd58e5',ramdisk_id='',reservation_id='r-2nwd1u0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2018122865',owner_user_name='tempest-ServerStableDeviceRescueTest-2018122865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:23:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='528d6b8363524661ac87940d9c29c521',uuid=9e076b98-3f30-4a9a-aa97-330c748de261,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Converting VIF {"id": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "address": "fa:16:3e:b6:d8:3f", "network": {"id": "69115285-947c-4b22-8c21-62c9d9c3578e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-799085865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1bdb986de2488da17a7f44b6bd58e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49dbd78d-29", "ovs_interfaceid": "49dbd78d-299e-4717-bf85-1a3ad0e83689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d8:3f,bridge_name='br-int',has_traffic_filtering=True,id=49dbd78d-299e-4717-bf85-1a3ad0e83689,network=Network(69115285-947c-4b22-8c21-62c9d9c3578e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dbd78d-29') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG os_vif [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d8:3f,bridge_name='br-int',has_traffic_filtering=True,id=49dbd78d-299e-4717-bf85-1a3ad0e83689,network=Network(69115285-947c-4b22-8c21-62c9d9c3578e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dbd78d-29') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49dbd78d-29, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=caecc8d3-ecc3-4444-800d-2bd83d97d331) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:27 user nova-compute[76815]: INFO os_vif [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d8:3f,bridge_name='br-int',has_traffic_filtering=True,id=49dbd78d-299e-4717-bf85-1a3ad0e83689,network=Network(69115285-947c-4b22-8c21-62c9d9c3578e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49dbd78d-29')
Nov 14 22:24:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Deleting instance files /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261_del
Nov 14 22:24:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Deletion of /opt/stack/data/nova/instances/9e076b98-3f30-4a9a-aa97-330c748de261_del complete
Nov 14 22:24:27 user nova-compute[76815]: INFO nova.compute.manager [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 22:24:27 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:24:27 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:24:28 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:28 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Took 0.90 seconds to deallocate network for instance.
Nov 14 22:24:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "5625e9a8-df68-4abb-a423-59143395837c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "5625e9a8-df68-4abb-a423-59143395837c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:24:29 user nova-compute[76815]: INFO nova.compute.claims [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Claim successful on node user
Nov 14 22:24:29 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Deleted allocations for instance 9e076b98-3f30-4a9a-aa97-330c748de261
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-35e5a2c6-b4b7-43e7-848d-54f6e351629e tempest-ServerStableDeviceRescueTest-2018122865 tempest-ServerStableDeviceRescueTest-2018122865-project-member] Lock "9e076b98-3f30-4a9a-aa97-330c748de261" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.300s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-8799ddfb-23c8-4e3f-9d00-818b2d1d9838 req-f9f40fe5-ccdc-4f3b-85e1-1382775e4061 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8799ddfb-23c8-4e3f-9d00-818b2d1d9838 req-f9f40fe5-ccdc-4f3b-85e1-1382775e4061 service nova] Acquiring lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8799ddfb-23c8-4e3f-9d00-818b2d1d9838 req-f9f40fe5-ccdc-4f3b-85e1-1382775e4061 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8799ddfb-23c8-4e3f-9d00-818b2d1d9838 req-f9f40fe5-ccdc-4f3b-85e1-1382775e4061 service nova] Lock "9e076b98-3f30-4a9a-aa97-330c748de261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-8799ddfb-23c8-4e3f-9d00-818b2d1d9838 req-f9f40fe5-ccdc-4f3b-85e1-1382775e4061 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] No waiting events found dispatching network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:29 user nova-compute[76815]: WARNING nova.compute.manager [req-8799ddfb-23c8-4e3f-9d00-818b2d1d9838 req-f9f40fe5-ccdc-4f3b-85e1-1382775e4061 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received unexpected event network-vif-plugged-49dbd78d-299e-4717-bf85-1a3ad0e83689 for instance with vm_state deleted and task_state None.
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-8799ddfb-23c8-4e3f-9d00-818b2d1d9838 req-f9f40fe5-ccdc-4f3b-85e1-1382775e4061 service nova] [instance: 9e076b98-3f30-4a9a-aa97-330c748de261] Received event network-vif-deleted-49dbd78d-299e-4717-bf85-1a3ad0e83689 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:24:29 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG nova.policy [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd5c7c940b0429994db55b93cb421ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673708a9f12541f6929c86eb60ca83c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:24:29 user nova-compute[76815]: INFO nova.virt.block_device [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Booting with volume 4d984fe4-59de-44c9-a2f3-29b71f1d854a at /dev/vda
Nov 14 22:24:29 user nova-compute[76815]: DEBUG os_brick.utils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3064ea33-9ff3-4166-8997-aa9e018a4fbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d69c568-8561-47d6-b2b8-c5e025bb00ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[482970a5-ac9a-47ed-980e-a9bff87240c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[301fef1f-4992-4225-a876-f23429523629]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:24:30 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:24:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ddc91c-84bc-4b63-8470-6b6af8075d2b]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG os_brick.utils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Updating existing volume attachment record: eeaad15a-9bb3-4f48-a30d-76352557c744 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:24:30 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Successfully created port: 1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Successfully updated port: 1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquired lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-7d885ce7-ecd6-4698-adf7-119810a990d0 req-41873209-5524-4c28-bdb7-2f84416acdab service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received event network-changed-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-7d885ce7-ecd6-4698-adf7-119810a990d0 req-41873209-5524-4c28-bdb7-2f84416acdab service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Refreshing instance network info cache due to event network-changed-1b25b7b1-c714-4772-91f1-4936cd9180af. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7d885ce7-ecd6-4698-adf7-119810a990d0 req-41873209-5524-4c28-bdb7-2f84416acdab service nova] Acquiring lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Updating instance_info_cache with network_info: [{"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Releasing lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Instance network_info: |[{"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7d885ce7-ecd6-4698-adf7-119810a990d0 req-41873209-5524-4c28-bdb7-2f84416acdab service nova] Acquired lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d885ce7-ecd6-4698-adf7-119810a990d0 req-41873209-5524-4c28-bdb7-2f84416acdab service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Refreshing network info cache for port 1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d885ce7-ecd6-4698-adf7-119810a990d0 req-41873209-5524-4c28-bdb7-2f84416acdab service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Updated VIF entry in instance network info cache for port 1b25b7b1-c714-4772-91f1-4936cd9180af. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG nova.network.neutron [req-7d885ce7-ecd6-4698-adf7-119810a990d0 req-41873209-5524-4c28-bdb7-2f84416acdab service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Updating instance_info_cache with network_info: [{"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7d885ce7-ecd6-4698-adf7-119810a990d0 req-41873209-5524-4c28-bdb7-2f84416acdab service nova] Releasing lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:24:34 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Creating image(s)
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Ensure instance console log exists: /opt/stack/data/nova/instances/5625e9a8-df68-4abb-a423-59143395837c/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Start _get_guest_xml network_info=[{"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTaBkxLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5625e9a8-df68-4abb-a423-59143395837c', 'attached_at': '', 'detached_at': '', 'volume_id': '4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'serial': '4d984fe4-59de-44c9-a2f3-29b71f1d854a'}, 'attachment_id': 'eeaad15a-9bb3-4f48-a30d-76352557c744', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:24:34 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:34 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTaBkxLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:24:34 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:24:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:24:34 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:24:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:24:34 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a11808a-6058-4a7e-8f1d-dd761b82b4e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:24:34 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff65b5bb-393f-419b-9cf4-74d0dea56427]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a] added
Nov 14 22:24:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[86377f09-6899-429e-a44d-5cf77d38047b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceb64a7-e10c-4527-b8ce-4274d737a6a6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTaBkxLV {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTaBkxLV" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[829bf2b8-7388-4d34-8c56-8f17778f08eb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTaBkxLV'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[157bc93f-bba5-4266-b0cf-e9af3e6a1e55]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a8f69-28a5-4af8-9a8d-d12b0a092dd5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:24:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:24:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7686d8fb-96c0-4dfe-914e-d5a97545bb18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260]
Nov 14 22:24:35 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260] successful.
Nov 14 22:24:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdba35be-25d5-41c3-9e97-186b34c1cc8a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c4e84a-1025-4394-a75a-ceb6e07e29d9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:24:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:24:35 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:24:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89948fb-70f8-44ad-b8c5-964c62e46be1]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:24:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTaBkxLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23766356563356235', 'path': '/dev/sde'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766356563356235', 'path': '/dev/sde'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-412997152',display_name='tempest-TestVolumeBootPattern-server-412997152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-412997152',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVEyUh19O0alKw62tv3KmxoqsN7lyGaF0+P2xIoHxT+cKRRBx4MW7gidGmxry5UdKm4qrUC1sXQJe9NOXzjEcpENxKgmVXT2xLtMcWY8QrB8wG3DfxFfdkpczVqlfoPA==',key_name='tempest-TestVolumeBootPattern-1688630530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-6a5ag83m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:24:30Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=5625e9a8-df68-4abb-a423-59143395837c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:84:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b25b7b1-c714-4772-91f1-4936cd9180af,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b25b7b1-c7') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.objects.instance [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'pci_devices' on Instance uuid 5625e9a8-df68-4abb-a423-59143395837c {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:24:36 user nova-compute[76815]:   <uuid>5625e9a8-df68-4abb-a423-59143395837c</uuid>
Nov 14 22:24:36 user nova-compute[76815]:   <name>instance-00000023</name>
Nov 14 22:24:36 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:24:36 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:24:36 user nova-compute[76815]:   <metadata>
Nov 14 22:24:36 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:24:36 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:24:36 user nova-compute[76815]:       <nova:name>tempest-TestVolumeBootPattern-server-412997152</nova:name>
Nov 14 22:24:36 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:24:34</nova:creationTime>
Nov 14 22:24:36 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:24:36 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:24:36 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:24:36 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:24:36 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:24:36 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:24:36 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:24:36 user nova-compute[76815]:       <nova:owner>
Nov 14 22:24:36 user nova-compute[76815]:         <nova:user uuid="0fd5c7c940b0429994db55b93cb421ed">tempest-TestVolumeBootPattern-1821264948-project-member</nova:user>
Nov 14 22:24:36 user nova-compute[76815]:         <nova:project uuid="673708a9f12541f6929c86eb60ca83c8">tempest-TestVolumeBootPattern-1821264948</nova:project>
Nov 14 22:24:36 user nova-compute[76815]:       </nova:owner>
Nov 14 22:24:36 user nova-compute[76815]:       <nova:ports>
Nov 14 22:24:36 user nova-compute[76815]:         <nova:port uuid="1b25b7b1-c714-4772-91f1-4936cd9180af">
Nov 14 22:24:36 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:24:36 user nova-compute[76815]:         </nova:port>
Nov 14 22:24:36 user nova-compute[76815]:       </nova:ports>
Nov 14 22:24:36 user nova-compute[76815]:     </nova:instance>
Nov 14 22:24:36 user nova-compute[76815]:   </metadata>
Nov 14 22:24:36 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:24:36 user nova-compute[76815]:     <system>
Nov 14 22:24:36 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:24:36 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:24:36 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:24:36 user nova-compute[76815]:       <entry name="serial">5625e9a8-df68-4abb-a423-59143395837c</entry>
Nov 14 22:24:36 user nova-compute[76815]:       <entry name="uuid">5625e9a8-df68-4abb-a423-59143395837c</entry>
Nov 14 22:24:36 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:24:36 user nova-compute[76815]:     </system>
Nov 14 22:24:36 user nova-compute[76815]:   </sysinfo>
Nov 14 22:24:36 user nova-compute[76815]:   <os>
Nov 14 22:24:36 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:24:36 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:24:36 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:24:36 user nova-compute[76815]:   </os>
Nov 14 22:24:36 user nova-compute[76815]:   <features>
Nov 14 22:24:36 user nova-compute[76815]:     <acpi/>
Nov 14 22:24:36 user nova-compute[76815]:     <apic/>
Nov 14 22:24:36 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:24:36 user nova-compute[76815]:   </features>
Nov 14 22:24:36 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:24:36 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:24:36 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:24:36 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:24:36 user nova-compute[76815]:   </clock>
Nov 14 22:24:36 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:24:36 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:24:36 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:24:36 user nova-compute[76815]:   </cpu>
Nov 14 22:24:36 user nova-compute[76815]:   <devices>
Nov 14 22:24:36 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:24:36 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:24:36 user nova-compute[76815]:       <source dev="/dev/sde"/>
Nov 14 22:24:36 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:24:36 user nova-compute[76815]:       <serial>4d984fe4-59de-44c9-a2f3-29b71f1d854a</serial>
Nov 14 22:24:36 user nova-compute[76815]:     </disk>
Nov 14 22:24:36 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:24:36 user nova-compute[76815]:       <mac address="fa:16:3e:4d:84:9c"/>
Nov 14 22:24:36 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:24:36 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:24:36 user nova-compute[76815]:       <target dev="tap1b25b7b1-c7"/>
Nov 14 22:24:36 user nova-compute[76815]:     </interface>
Nov 14 22:24:36 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:24:36 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/5625e9a8-df68-4abb-a423-59143395837c/console.log" append="off"/>
Nov 14 22:24:36 user nova-compute[76815]:     </serial>
Nov 14 22:24:36 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:24:36 user nova-compute[76815]:     <video>
Nov 14 22:24:36 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:24:36 user nova-compute[76815]:     </video>
Nov 14 22:24:36 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:24:36 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:24:36 user nova-compute[76815]:     </rng>
Nov 14 22:24:36 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:24:36 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:24:36 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:24:36 user nova-compute[76815]:     </memballoon>
Nov 14 22:24:36 user nova-compute[76815]:   </devices>
Nov 14 22:24:36 user nova-compute[76815]: </domain>
Nov 14 22:24:36 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-412997152',display_name='tempest-TestVolumeBootPattern-server-412997152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-412997152',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVEyUh19O0alKw62tv3KmxoqsN7lyGaF0+P2xIoHxT+cKRRBx4MW7gidGmxry5UdKm4qrUC1sXQJe9NOXzjEcpENxKgmVXT2xLtMcWY8QrB8wG3DfxFfdkpczVqlfoPA==',key_name='tempest-TestVolumeBootPattern-1688630530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-6a5ag83m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:24:30Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=5625e9a8-df68-4abb-a423-59143395837c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:84:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b25b7b1-c714-4772-91f1-4936cd9180af,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b25b7b1-c7') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG os_vif [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:84:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b25b7b1-c714-4772-91f1-4936cd9180af,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b25b7b1-c7') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '965cba02-a468-5a7b-acf4-cf0f70beafa7', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b25b7b1-c7, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b25b7b1-c7, col_values=(('qos', UUID('1ea5fc9c-f0bc-4e88-9583-16a9bcecbb39')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b25b7b1-c7, col_values=(('external_ids', {'iface-id': '1b25b7b1-c714-4772-91f1-4936cd9180af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:84:9c', 'vm-uuid': '5625e9a8-df68-4abb-a423-59143395837c'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:36 user nova-compute[76815]: INFO os_vif [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:84:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b25b7b1-c714-4772-91f1-4936cd9180af,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b25b7b1-c7')
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:24:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No VIF found with MAC fa:16:3e:4d:84:9c, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:24:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-380e5105-6d5a-43e2-8584-ecee7ff04422 req-9f5fce13-a7a5-49ce-a868-7255cecbc886 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received event network-vif-plugged-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-380e5105-6d5a-43e2-8584-ecee7ff04422 req-9f5fce13-a7a5-49ce-a868-7255cecbc886 service nova] Acquiring lock "5625e9a8-df68-4abb-a423-59143395837c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-380e5105-6d5a-43e2-8584-ecee7ff04422 req-9f5fce13-a7a5-49ce-a868-7255cecbc886 service nova] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-380e5105-6d5a-43e2-8584-ecee7ff04422 req-9f5fce13-a7a5-49ce-a868-7255cecbc886 service nova] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-380e5105-6d5a-43e2-8584-ecee7ff04422 req-9f5fce13-a7a5-49ce-a868-7255cecbc886 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] No waiting events found dispatching network-vif-plugged-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:37 user nova-compute[76815]: WARNING nova.compute.manager [req-380e5105-6d5a-43e2-8584-ecee7ff04422 req-9f5fce13-a7a5-49ce-a868-7255cecbc886 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received unexpected event network-vif-plugged-1b25b7b1-c714-4772-91f1-4936cd9180af for instance with vm_state building and task_state spawning.
Nov 14 22:24:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:24:39 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Instance spawned successfully.
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-2e5703c8-7053-4a6b-b283-e0099026bf3d req-3c384344-e2c0-4379-85c8-ae33bfb45bb3 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received event network-vif-plugged-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e5703c8-7053-4a6b-b283-e0099026bf3d req-3c384344-e2c0-4379-85c8-ae33bfb45bb3 service nova] Acquiring lock "5625e9a8-df68-4abb-a423-59143395837c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e5703c8-7053-4a6b-b283-e0099026bf3d req-3c384344-e2c0-4379-85c8-ae33bfb45bb3 service nova] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e5703c8-7053-4a6b-b283-e0099026bf3d req-3c384344-e2c0-4379-85c8-ae33bfb45bb3 service nova] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-2e5703c8-7053-4a6b-b283-e0099026bf3d req-3c384344-e2c0-4379-85c8-ae33bfb45bb3 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] No waiting events found dispatching network-vif-plugged-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:39 user nova-compute[76815]: WARNING nova.compute.manager [req-2e5703c8-7053-4a6b-b283-e0099026bf3d req-3c384344-e2c0-4379-85c8-ae33bfb45bb3 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received unexpected event network-vif-plugged-1b25b7b1-c714-4772-91f1-4936cd9180af for instance with vm_state building and task_state spawning.
Nov 14 22:24:39 user nova-compute[76815]: INFO nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 14 22:24:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:24:39 user nova-compute[76815]: INFO nova.compute.manager [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Took 10.65 seconds to build instance.
Nov 14 22:24:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea852f18-33bf-4f15-949f-439bfc0ad161 tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "5625e9a8-df68-4abb-a423-59143395837c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.783s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:24:41 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:41 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8165MB free_disk=25.070392608642578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Applying migration context for instance 3d82c8bf-899a-4e18-9738-8b6d067867bf as it has an incoming, in-progress migration 3b7a8642-d37b-4073-b59c-4157768f0cea. Migration status is finished {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 22:24:41 user nova-compute[76815]: INFO nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating resource usage from migration 3b7a8642-d37b-4073-b59c-4157768f0cea
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 6bf4d919-7b71-4a01-8f73-f23f5ba76526 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Migration 3b7a8642-d37b-4073-b59c-4157768f0cea is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3d82c8bf-899a-4e18-9738-8b6d067867bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 5625e9a8-df68-4abb-a423-59143395837c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:24:41 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:24:45 user nova-compute[76815]: INFO nova.compute.claims [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Claim successful on node user
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:24:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.policy [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50afb4444eea433ba80e4f4e84821101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bad961b0e704e2483d2de3d382a23b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:24:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Creating image(s)
Nov 14 22:24:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Skipping network cache update for instance because it is Building. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid a8bb243d-ad93-47ae-8fbe-b5845a29496d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk 1073741824" returned: 0 in 0.049s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Successfully created port: 26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Cannot resize image /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Ensure instance console log exists: /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updating instance_info_cache with network_info: [{"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Successfully updated port: 26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquired lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-b2252dc2-b5d5-46c9-89d4-14c614a0f551 req-6e30670d-f9ec-4f43-bd6c-ec78eb71a9cb service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-changed-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-b2252dc2-b5d5-46c9-89d4-14c614a0f551 req-6e30670d-f9ec-4f43-bd6c-ec78eb71a9cb service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Refreshing instance network info cache due to event network-changed-26aeb0f8-3e23-4d18-946a-deec39e9788a. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b2252dc2-b5d5-46c9-89d4-14c614a0f551 req-6e30670d-f9ec-4f43-bd6c-ec78eb71a9cb service nova] Acquiring lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updating instance_info_cache with network_info: [{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Releasing lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance network_info: |[{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b2252dc2-b5d5-46c9-89d4-14c614a0f551 req-6e30670d-f9ec-4f43-bd6c-ec78eb71a9cb service nova] Acquired lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.network.neutron [req-b2252dc2-b5d5-46c9-89d4-14c614a0f551 req-6e30670d-f9ec-4f43-bd6c-ec78eb71a9cb service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Refreshing network info cache for port 26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Start _get_guest_xml network_info=[{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:24:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:24:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-534347897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-534347897',id=36,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZILfldAReFZ5UtvJtfYXt/dkmY/wU8c/O723H+6gC1WF12YMQsz92HeN79HKXyOKV/c5QfCiehJOw5MxSa1EU1XguruLemXyjytD1YssyT5k8QEqVLL6jZBnY8qp3AnA==',key_name='tempest-keypair-621748568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-tkwhh7x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:24:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=6c5a15b3-6d75-459b-a379-b756124a9c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:24:47 user nova-compute[76815]:   <uuid>6c5a15b3-6d75-459b-a379-b756124a9c29</uuid>
Nov 14 22:24:47 user nova-compute[76815]:   <name>instance-00000024</name>
Nov 14 22:24:47 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:24:47 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:24:47 user nova-compute[76815]:   <metadata>
Nov 14 22:24:47 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:24:47 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:24:47 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-534347897</nova:name>
Nov 14 22:24:47 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:24:47</nova:creationTime>
Nov 14 22:24:47 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:24:47 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:24:47 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:24:47 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:24:47 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:24:47 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:24:47 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:24:47 user nova-compute[76815]:       <nova:owner>
Nov 14 22:24:47 user nova-compute[76815]:         <nova:user uuid="50afb4444eea433ba80e4f4e84821101">tempest-AttachVolumeShelveTestJSON-1125875673-project-member</nova:user>
Nov 14 22:24:47 user nova-compute[76815]:         <nova:project uuid="4bad961b0e704e2483d2de3d382a23b6">tempest-AttachVolumeShelveTestJSON-1125875673</nova:project>
Nov 14 22:24:47 user nova-compute[76815]:       </nova:owner>
Nov 14 22:24:47 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:24:47 user nova-compute[76815]:       <nova:ports>
Nov 14 22:24:47 user nova-compute[76815]:         <nova:port uuid="26aeb0f8-3e23-4d18-946a-deec39e9788a">
Nov 14 22:24:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 22:24:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:24:47 user nova-compute[76815]:       </nova:ports>
Nov 14 22:24:47 user nova-compute[76815]:     </nova:instance>
Nov 14 22:24:47 user nova-compute[76815]:   </metadata>
Nov 14 22:24:47 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:24:47 user nova-compute[76815]:     <system>
Nov 14 22:24:47 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:24:47 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:24:47 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:24:47 user nova-compute[76815]:       <entry name="serial">6c5a15b3-6d75-459b-a379-b756124a9c29</entry>
Nov 14 22:24:47 user nova-compute[76815]:       <entry name="uuid">6c5a15b3-6d75-459b-a379-b756124a9c29</entry>
Nov 14 22:24:47 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:24:47 user nova-compute[76815]:     </system>
Nov 14 22:24:47 user nova-compute[76815]:   </sysinfo>
Nov 14 22:24:47 user nova-compute[76815]:   <os>
Nov 14 22:24:47 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:24:47 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:24:47 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:24:47 user nova-compute[76815]:   </os>
Nov 14 22:24:47 user nova-compute[76815]:   <features>
Nov 14 22:24:47 user nova-compute[76815]:     <acpi/>
Nov 14 22:24:47 user nova-compute[76815]:     <apic/>
Nov 14 22:24:47 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:24:47 user nova-compute[76815]:   </features>
Nov 14 22:24:47 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:24:47 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:24:47 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:24:47 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:24:47 user nova-compute[76815]:   </clock>
Nov 14 22:24:47 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:24:47 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:24:47 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:24:47 user nova-compute[76815]:   </cpu>
Nov 14 22:24:47 user nova-compute[76815]:   <devices>
Nov 14 22:24:47 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:24:47 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:24:47 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk"/>
Nov 14 22:24:47 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:24:47 user nova-compute[76815]:     </disk>
Nov 14 22:24:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:24:47 user nova-compute[76815]:       <mac address="fa:16:3e:59:87:4f"/>
Nov 14 22:24:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:24:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:24:47 user nova-compute[76815]:       <target dev="tap26aeb0f8-3e"/>
Nov 14 22:24:47 user nova-compute[76815]:     </interface>
Nov 14 22:24:47 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:24:47 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/console.log" append="off"/>
Nov 14 22:24:47 user nova-compute[76815]:     </serial>
Nov 14 22:24:47 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:24:47 user nova-compute[76815]:     <video>
Nov 14 22:24:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:24:47 user nova-compute[76815]:     </video>
Nov 14 22:24:47 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:24:47 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:24:47 user nova-compute[76815]:     </rng>
Nov 14 22:24:47 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:24:47 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:24:47 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:24:47 user nova-compute[76815]:     </memballoon>
Nov 14 22:24:47 user nova-compute[76815]:   </devices>
Nov 14 22:24:47 user nova-compute[76815]: </domain>
Nov 14 22:24:47 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:24:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-534347897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-534347897',id=36,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZILfldAReFZ5UtvJtfYXt/dkmY/wU8c/O723H+6gC1WF12YMQsz92HeN79HKXyOKV/c5QfCiehJOw5MxSa1EU1XguruLemXyjytD1YssyT5k8QEqVLL6jZBnY8qp3AnA==',key_name='tempest-keypair-621748568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-tkwhh7x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:24:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=6c5a15b3-6d75-459b-a379-b756124a9c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG os_vif [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '977d5627-0ea6-509d-bd9e-45306d263770', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26aeb0f8-3e, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26aeb0f8-3e, col_values=(('qos', UUID('5279cfb9-e320-4b9a-bedc-a028eabddf9d')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26aeb0f8-3e, col_values=(('external_ids', {'iface-id': '26aeb0f8-3e23-4d18-946a-deec39e9788a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:87:4f', 'vm-uuid': '6c5a15b3-6d75-459b-a379-b756124a9c29'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:47 user nova-compute[76815]: INFO os_vif [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e')
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:24:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] No VIF found with MAC fa:16:3e:59:87:4f, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:24:48 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:24:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-b2252dc2-b5d5-46c9-89d4-14c614a0f551 req-6e30670d-f9ec-4f43-bd6c-ec78eb71a9cb service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updated VIF entry in instance network info cache for port 26aeb0f8-3e23-4d18-946a-deec39e9788a. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:24:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-b2252dc2-b5d5-46c9-89d4-14c614a0f551 req-6e30670d-f9ec-4f43-bd6c-ec78eb71a9cb service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updating instance_info_cache with network_info: [{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:24:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b2252dc2-b5d5-46c9-89d4-14c614a0f551 req-6e30670d-f9ec-4f43-bd6c-ec78eb71a9cb service nova] Releasing lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:24:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-2e9c4953-d120-48f5-a3b6-2cfce59c7eb5 req-3f83a014-c692-4153-ad61-f4846b6d9f43 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e9c4953-d120-48f5-a3b6-2cfce59c7eb5 req-3f83a014-c692-4153-ad61-f4846b6d9f43 service nova] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e9c4953-d120-48f5-a3b6-2cfce59c7eb5 req-3f83a014-c692-4153-ad61-f4846b6d9f43 service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e9c4953-d120-48f5-a3b6-2cfce59c7eb5 req-3f83a014-c692-4153-ad61-f4846b6d9f43 service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-2e9c4953-d120-48f5-a3b6-2cfce59c7eb5 req-3f83a014-c692-4153-ad61-f4846b6d9f43 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] No waiting events found dispatching network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:49 user nova-compute[76815]: WARNING nova.compute.manager [req-2e9c4953-d120-48f5-a3b6-2cfce59c7eb5 req-3f83a014-c692-4153-ad61-f4846b6d9f43 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received unexpected event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a for instance with vm_state building and task_state spawning.
Nov 14 22:24:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:24:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance spawned successfully.
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-45546649-5dc6-479c-ac9f-08538c2913a7 req-5ab6280e-3fad-4e28-bc97-6a669ec48bd6 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45546649-5dc6-479c-ac9f-08538c2913a7 req-5ab6280e-3fad-4e28-bc97-6a669ec48bd6 service nova] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45546649-5dc6-479c-ac9f-08538c2913a7 req-5ab6280e-3fad-4e28-bc97-6a669ec48bd6 service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-45546649-5dc6-479c-ac9f-08538c2913a7 req-5ab6280e-3fad-4e28-bc97-6a669ec48bd6 service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-45546649-5dc6-479c-ac9f-08538c2913a7 req-5ab6280e-3fad-4e28-bc97-6a669ec48bd6 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] No waiting events found dispatching network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:24:51 user nova-compute[76815]: WARNING nova.compute.manager [req-45546649-5dc6-479c-ac9f-08538c2913a7 req-5ab6280e-3fad-4e28-bc97-6a669ec48bd6 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received unexpected event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a for instance with vm_state building and task_state spawning.
Nov 14 22:24:51 user nova-compute[76815]: INFO nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 14 22:24:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:24:51 user nova-compute[76815]: INFO nova.compute.manager [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Took 6.01 seconds to build instance.
Nov 14 22:24:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0928d150-0021-40ab-8b63-7237a0e65fbc tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.118s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:24:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:24:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquiring lock "e4583d20-0b4a-47fc-8ac0-75408503371e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:25:33 user nova-compute[76815]: INFO nova.compute.claims [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Claim successful on node user
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.network.neutron [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:25:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:25:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Creating image(s)
Nov 14 22:25:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "/opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "/opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG nova.policy [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52500233058942f2af786a1c5e29c0a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd4f206f9904de3bbeab0472dd431a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk 1073741824" returned: 0 in 0.054s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.167s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Successfully created port: 51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Cannot resize image /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Ensure instance console log exists: /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Successfully updated port: 51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquiring lock "refresh_cache-e4583d20-0b4a-47fc-8ac0-75408503371e" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquired lock "refresh_cache-e4583d20-0b4a-47fc-8ac0-75408503371e" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-7a00b54f-a4c2-49d4-b31e-f344bab79066 req-02dcc474-b29c-4f2c-8a1f-c69e326c2f6a service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received event network-changed-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-7a00b54f-a4c2-49d4-b31e-f344bab79066 req-02dcc474-b29c-4f2c-8a1f-c69e326c2f6a service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Refreshing instance network info cache due to event network-changed-51e84a81-4a71-4df3-a161-f4086f9223fd. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7a00b54f-a4c2-49d4-b31e-f344bab79066 req-02dcc474-b29c-4f2c-8a1f-c69e326c2f6a service nova] Acquiring lock "refresh_cache-e4583d20-0b4a-47fc-8ac0-75408503371e" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.network.neutron [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Updating instance_info_cache with network_info: [{"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Releasing lock "refresh_cache-e4583d20-0b4a-47fc-8ac0-75408503371e" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Instance network_info: |[{"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7a00b54f-a4c2-49d4-b31e-f344bab79066 req-02dcc474-b29c-4f2c-8a1f-c69e326c2f6a service nova] Acquired lock "refresh_cache-e4583d20-0b4a-47fc-8ac0-75408503371e" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-7a00b54f-a4c2-49d4-b31e-f344bab79066 req-02dcc474-b29c-4f2c-8a1f-c69e326c2f6a service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Refreshing network info cache for port 51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Start _get_guest_xml network_info=[{"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:25:35 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:25:35 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1148014441',display_name='tempest-VolumesNegativeTest-instance-1148014441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1148014441',id=37,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd4f206f9904de3bbeab0472dd431a7',ramdisk_id='',reservation_id='r-70okrppk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1092805728',owner_user_name='tempest-VolumesNegativeTest-1092805728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:25:34Z,user_data=None,user_id='52500233058942f2af786a1c5e29c0a9',uuid=e4583d20-0b4a-47fc-8ac0-75408503371e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Converting VIF {"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:96:40,bridge_name='br-int',has_traffic_filtering=True,id=51e84a81-4a71-4df3-a161-f4086f9223fd,network=Network(1f44c72a-4877-41b0-b19d-905ff0aa6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e84a81-4a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.objects.instance [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lazy-loading 'pci_devices' on Instance uuid e4583d20-0b4a-47fc-8ac0-75408503371e {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:25:35 user nova-compute[76815]:   <uuid>e4583d20-0b4a-47fc-8ac0-75408503371e</uuid>
Nov 14 22:25:35 user nova-compute[76815]:   <name>instance-00000025</name>
Nov 14 22:25:35 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:25:35 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:25:35 user nova-compute[76815]:   <metadata>
Nov 14 22:25:35 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:25:35 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:25:35 user nova-compute[76815]:       <nova:name>tempest-VolumesNegativeTest-instance-1148014441</nova:name>
Nov 14 22:25:35 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:25:35</nova:creationTime>
Nov 14 22:25:35 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:25:35 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:25:35 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:25:35 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:25:35 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:25:35 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:25:35 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:25:35 user nova-compute[76815]:       <nova:owner>
Nov 14 22:25:35 user nova-compute[76815]:         <nova:user uuid="52500233058942f2af786a1c5e29c0a9">tempest-VolumesNegativeTest-1092805728-project-member</nova:user>
Nov 14 22:25:35 user nova-compute[76815]:         <nova:project uuid="0bd4f206f9904de3bbeab0472dd431a7">tempest-VolumesNegativeTest-1092805728</nova:project>
Nov 14 22:25:35 user nova-compute[76815]:       </nova:owner>
Nov 14 22:25:35 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:25:35 user nova-compute[76815]:       <nova:ports>
Nov 14 22:25:35 user nova-compute[76815]:         <nova:port uuid="51e84a81-4a71-4df3-a161-f4086f9223fd">
Nov 14 22:25:35 user nova-compute[76815]:           <nova:ip type="fixed" address="192.168.233.132" ipVersion="4"/>
Nov 14 22:25:35 user nova-compute[76815]:         </nova:port>
Nov 14 22:25:35 user nova-compute[76815]:       </nova:ports>
Nov 14 22:25:35 user nova-compute[76815]:     </nova:instance>
Nov 14 22:25:35 user nova-compute[76815]:   </metadata>
Nov 14 22:25:35 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:25:35 user nova-compute[76815]:     <system>
Nov 14 22:25:35 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:25:35 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:25:35 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:25:35 user nova-compute[76815]:       <entry name="serial">e4583d20-0b4a-47fc-8ac0-75408503371e</entry>
Nov 14 22:25:35 user nova-compute[76815]:       <entry name="uuid">e4583d20-0b4a-47fc-8ac0-75408503371e</entry>
Nov 14 22:25:35 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:25:35 user nova-compute[76815]:     </system>
Nov 14 22:25:35 user nova-compute[76815]:   </sysinfo>
Nov 14 22:25:35 user nova-compute[76815]:   <os>
Nov 14 22:25:35 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:25:35 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:25:35 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:25:35 user nova-compute[76815]:   </os>
Nov 14 22:25:35 user nova-compute[76815]:   <features>
Nov 14 22:25:35 user nova-compute[76815]:     <acpi/>
Nov 14 22:25:35 user nova-compute[76815]:     <apic/>
Nov 14 22:25:35 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:25:35 user nova-compute[76815]:   </features>
Nov 14 22:25:35 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:25:35 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:25:35 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:25:35 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:25:35 user nova-compute[76815]:   </clock>
Nov 14 22:25:35 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:25:35 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:25:35 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:25:35 user nova-compute[76815]:   </cpu>
Nov 14 22:25:35 user nova-compute[76815]:   <devices>
Nov 14 22:25:35 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:25:35 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:25:35 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk"/>
Nov 14 22:25:35 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:25:35 user nova-compute[76815]:     </disk>
Nov 14 22:25:35 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:25:35 user nova-compute[76815]:       <mac address="fa:16:3e:63:96:40"/>
Nov 14 22:25:35 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:25:35 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:25:35 user nova-compute[76815]:       <target dev="tap51e84a81-4a"/>
Nov 14 22:25:35 user nova-compute[76815]:     </interface>
Nov 14 22:25:35 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:25:35 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/console.log" append="off"/>
Nov 14 22:25:35 user nova-compute[76815]:     </serial>
Nov 14 22:25:35 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:25:35 user nova-compute[76815]:     <video>
Nov 14 22:25:35 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:25:35 user nova-compute[76815]:     </video>
Nov 14 22:25:35 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:25:35 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:25:35 user nova-compute[76815]:     </rng>
Nov 14 22:25:35 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:25:35 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:25:35 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:25:35 user nova-compute[76815]:     </memballoon>
Nov 14 22:25:35 user nova-compute[76815]:   </devices>
Nov 14 22:25:35 user nova-compute[76815]: </domain>
Nov 14 22:25:35 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1148014441',display_name='tempest-VolumesNegativeTest-instance-1148014441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1148014441',id=37,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0bd4f206f9904de3bbeab0472dd431a7',ramdisk_id='',reservation_id='r-70okrppk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1092805728',owner_user_name='tempest-VolumesNegativeTest-1092805728-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:25:34Z,user_data=None,user_id='52500233058942f2af786a1c5e29c0a9',uuid=e4583d20-0b4a-47fc-8ac0-75408503371e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Converting VIF {"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:96:40,bridge_name='br-int',has_traffic_filtering=True,id=51e84a81-4a71-4df3-a161-f4086f9223fd,network=Network(1f44c72a-4877-41b0-b19d-905ff0aa6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e84a81-4a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG os_vif [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:96:40,bridge_name='br-int',has_traffic_filtering=True,id=51e84a81-4a71-4df3-a161-f4086f9223fd,network=Network(1f44c72a-4877-41b0-b19d-905ff0aa6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e84a81-4a') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3379309d-acec-5939-8230-88f83438357a', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51e84a81-4a, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51e84a81-4a, col_values=(('qos', UUID('9a632822-fb3c-491b-a299-cbc705d6049d')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51e84a81-4a, col_values=(('external_ids', {'iface-id': '51e84a81-4a71-4df3-a161-f4086f9223fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:96:40', 'vm-uuid': 'e4583d20-0b4a-47fc-8ac0-75408503371e'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:35 user nova-compute[76815]: INFO os_vif [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:96:40,bridge_name='br-int',has_traffic_filtering=True,id=51e84a81-4a71-4df3-a161-f4086f9223fd,network=Network(1f44c72a-4877-41b0-b19d-905ff0aa6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e84a81-4a')
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:25:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] No VIF found with MAC fa:16:3e:63:96:40, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:25:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-7a00b54f-a4c2-49d4-b31e-f344bab79066 req-02dcc474-b29c-4f2c-8a1f-c69e326c2f6a service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Updated VIF entry in instance network info cache for port 51e84a81-4a71-4df3-a161-f4086f9223fd. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:25:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-7a00b54f-a4c2-49d4-b31e-f344bab79066 req-02dcc474-b29c-4f2c-8a1f-c69e326c2f6a service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Updating instance_info_cache with network_info: [{"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:25:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7a00b54f-a4c2-49d4-b31e-f344bab79066 req-02dcc474-b29c-4f2c-8a1f-c69e326c2f6a service nova] Releasing lock "refresh_cache-e4583d20-0b4a-47fc-8ac0-75408503371e" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-d6a76fde-04d1-4a11-9460-48a0f2807d4a req-d7510fbd-b818-4205-ba8a-1bc8794f1bbc service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received event network-vif-plugged-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d6a76fde-04d1-4a11-9460-48a0f2807d4a req-d7510fbd-b818-4205-ba8a-1bc8794f1bbc service nova] Acquiring lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d6a76fde-04d1-4a11-9460-48a0f2807d4a req-d7510fbd-b818-4205-ba8a-1bc8794f1bbc service nova] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d6a76fde-04d1-4a11-9460-48a0f2807d4a req-d7510fbd-b818-4205-ba8a-1bc8794f1bbc service nova] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-d6a76fde-04d1-4a11-9460-48a0f2807d4a req-d7510fbd-b818-4205-ba8a-1bc8794f1bbc service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] No waiting events found dispatching network-vif-plugged-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:25:37 user nova-compute[76815]: WARNING nova.compute.manager [req-d6a76fde-04d1-4a11-9460-48a0f2807d4a req-d7510fbd-b818-4205-ba8a-1bc8794f1bbc service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received unexpected event network-vif-plugged-51e84a81-4a71-4df3-a161-f4086f9223fd for instance with vm_state building and task_state spawning.
Nov 14 22:25:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:25:39 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Instance spawned successfully.
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:25:39 user nova-compute[76815]: INFO nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:25:39 user nova-compute[76815]: INFO nova.compute.manager [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Took 6.10 seconds to build instance.
Nov 14 22:25:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd9f0d6c-9e2b-4a04-809a-55d5d75d10d8 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.194s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-2096adfb-5b55-4e96-8638-64cdc9f94385 req-7267d4ea-df6d-4611-ba0c-a2749bb58206 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received event network-vif-plugged-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2096adfb-5b55-4e96-8638-64cdc9f94385 req-7267d4ea-df6d-4611-ba0c-a2749bb58206 service nova] Acquiring lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2096adfb-5b55-4e96-8638-64cdc9f94385 req-7267d4ea-df6d-4611-ba0c-a2749bb58206 service nova] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2096adfb-5b55-4e96-8638-64cdc9f94385 req-7267d4ea-df6d-4611-ba0c-a2749bb58206 service nova] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-2096adfb-5b55-4e96-8638-64cdc9f94385 req-7267d4ea-df6d-4611-ba0c-a2749bb58206 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] No waiting events found dispatching network-vif-plugged-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:25:39 user nova-compute[76815]: WARNING nova.compute.manager [req-2096adfb-5b55-4e96-8638-64cdc9f94385 req-7267d4ea-df6d-4611-ba0c-a2749bb58206 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received unexpected event network-vif-plugged-51e84a81-4a71-4df3-a161-f4086f9223fd for instance with vm_state active and task_state None.
Nov 14 22:25:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:25:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:25:44 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:25:44 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7919MB free_disk=25.038436889648438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Applying migration context for instance 3d82c8bf-899a-4e18-9738-8b6d067867bf as it has an incoming, in-progress migration 3b7a8642-d37b-4073-b59c-4157768f0cea. Migration status is finished {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 22:25:44 user nova-compute[76815]: INFO nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating resource usage from migration 3b7a8642-d37b-4073-b59c-4157768f0cea
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 6bf4d919-7b71-4a01-8f73-f23f5ba76526 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Migration 3b7a8642-d37b-4073-b59c-4157768f0cea is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3d82c8bf-899a-4e18-9738-8b6d067867bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 5625e9a8-df68-4abb-a423-59143395837c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 6c5a15b3-6d75-459b-a379-b756124a9c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance e4583d20-0b4a-47fc-8ac0-75408503371e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:25:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:25:45 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:25:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:25:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:25:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 065c90e1-2099-4446-a998-de681bedf500] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:25:47 user nova-compute[76815]: INFO nova.compute.manager [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Rescuing
Nov 14 22:25:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquired lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updating instance_info_cache with network_info: [{"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-065c90e1-2099-4446-a998-de681bedf500" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG nova.network.neutron [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updating instance_info_cache with network_info: [{"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Releasing lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-203203ac-38c8-4a0e-a703-98094c85cb13 req-801314b6-d7e6-41a0-b3ad-50bea34c84d1 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-unplugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-203203ac-38c8-4a0e-a703-98094c85cb13 req-801314b6-d7e6-41a0-b3ad-50bea34c84d1 service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-203203ac-38c8-4a0e-a703-98094c85cb13 req-801314b6-d7e6-41a0-b3ad-50bea34c84d1 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-203203ac-38c8-4a0e-a703-98094c85cb13 req-801314b6-d7e6-41a0-b3ad-50bea34c84d1 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-203203ac-38c8-4a0e-a703-98094c85cb13 req-801314b6-d7e6-41a0-b3ad-50bea34c84d1 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-unplugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:25:48 user nova-compute[76815]: WARNING nova.compute.manager [req-203203ac-38c8-4a0e-a703-98094c85cb13 req-801314b6-d7e6-41a0-b3ad-50bea34c84d1 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-unplugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state active and task_state rescuing.
Nov 14 22:25:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Instance destroyed successfully.
Nov 14 22:25:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Attempting a stable device rescue
Nov 14 22:25:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 22:25:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Instance directory exists: not creating {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 22:25:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Creating image(s)
Nov 14 22:25:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "/opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "/opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:49 user nova-compute[76815]: DEBUG nova.objects.instance [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:25:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "c13186948b77db895a2bd90cd8af029f96bc94d6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "c13186948b77db895a2bd90cd8af029f96bc94d6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6.part --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG nova.virt.images [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] eeb0e8d9-cd97-44e8-9702-0043c3b2a550 was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6.part /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-37c1ed98-5998-4912-9559-85a709fe88d7 req-8685559b-81c5-417c-8eac-b8962573649b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37c1ed98-5998-4912-9559-85a709fe88d7 req-8685559b-81c5-417c-8eac-b8962573649b service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37c1ed98-5998-4912-9559-85a709fe88d7 req-8685559b-81c5-417c-8eac-b8962573649b service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37c1ed98-5998-4912-9559-85a709fe88d7 req-8685559b-81c5-417c-8eac-b8962573649b service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-37c1ed98-5998-4912-9559-85a709fe88d7 req-8685559b-81c5-417c-8eac-b8962573649b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:25:50 user nova-compute[76815]: WARNING nova.compute.manager [req-37c1ed98-5998-4912-9559-85a709fe88d7 req-8685559b-81c5-417c-8eac-b8962573649b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state active and task_state rescuing.
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6.part /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6.converted" returned: 0 in 0.511s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "c13186948b77db895a2bd90cd8af029f96bc94d6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.816s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "c13186948b77db895a2bd90cd8af029f96bc94d6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "c13186948b77db895a2bd90cd8af029f96bc94d6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6 --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6,backing_fmt=raw /opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.rescue {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6,backing_fmt=raw /opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.rescue" returned: 0 in 0.046s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "c13186948b77db895a2bd90cd8af029f96bc94d6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'migration_context' on Instance uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<6bf4d919-7b71-4a01-8f73-f23f5ba76526> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Start _get_guest_xml network_info=[{"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "vif_mac": "fa:16:3e:82:15:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eeb0e8d9-cd97-44e8-9702-0043c3b2a550', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQZdafv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6bf4d919-7b71-4a01-8f73-f23f5ba76526', 'attached_at': '', 'detached_at': '', 'volume_id': 'b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 'serial': 'b322f8f6-b262-4a1d-a26a-e74aa9ee748a'}, 'attachment_id': 'b0937b20-4df3-4bfa-a2eb-1bfdcd6ccffd', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'resources' on Instance uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<6bf4d919-7b71-4a01-8f73-f23f5ba76526> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'numa_topology' on Instance uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<6bf4d919-7b71-4a01-8f73-f23f5ba76526> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:25:51 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:25:51 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<6bf4d919-7b71-4a01-8f73-f23f5ba76526> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQZdafv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:25:51 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:25:51 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:25:51 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a6e403-c439-466b-b5c7-ae6aa4252020]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eUQZdafv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 22:25:51 user nova-compute[76815]: node.name = iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a
Nov 14 22:25:51 user nova-compute[76815]: node.tpgt = -1
Nov 14 22:25:51 user nova-compute[76815]: node.startup = automatic
Nov 14 22:25:51 user nova-compute[76815]: node.leading_login = No
Nov 14 22:25:51 user nova-compute[76815]: iface.iscsi_ifacename = default
Nov 14 22:25:51 user nova-compute[76815]: iface.net_ifacename = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.ipaddress = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.prefix_len = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.hwaddress = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.transport_name = tcp
Nov 14 22:25:51 user nova-compute[76815]: iface.initiatorname = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.state = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.vlan_id = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.vlan_priority = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.vlan_state = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.iface_num = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.mtu = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.port = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.bootproto = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.subnet_mask = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.gateway = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.dhcp_alt_client_id = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.dhcp_dns = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.dhcp_learn_iqn = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.dhcp_vendor_id_state = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.dhcp_vendor_id = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.dhcp_slp_da = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.fragmentation = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.gratuitous_arp = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.incoming_forwarding = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.tos_state = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.tos = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.ttl = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.delayed_ack = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.tcp_nagle = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.tcp_wsf_state = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.tcp_wsf = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.tcp_timer_scale = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.tcp_timestamp = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.redirect = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.def_task_mgmt_timeout = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.header_digest = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.data_digest = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.immediate_data = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.initial_r2t = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.data_seq_inorder = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.data_pdu_inorder = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.erl = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.max_receive_data_len = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.first_burst_len = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.max_outstanding_r2t = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.max_burst_len = 0
Nov 14 22:25:51 user nova-compute[76815]: iface.chap_auth = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.bidi_chap = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.strict_login_compliance = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.discovery_auth = <empty>
Nov 14 22:25:51 user nova-compute[76815]: iface.discovery_logout = <empty>
Nov 14 22:25:51 user nova-compute[76815]: node.discovery_address = <empty>
Nov 14 22:25:51 user nova-compute[76815]: node.discovery_port = 0
Nov 14 22:25:51 user nova-compute[76815]: node.discovery_type = static
Nov 14 22:25:51 user nova-compute[76815]: node.session.initial_cmdsn = 0
Nov 14 22:25:51 user nova-compute[76815]: node.session.initial_login_retry_max = 8
Nov 14 22:25:51 user nova-compute[76815]: node.session.xmit_thread_priority = -20
Nov 14 22:25:51 user nova-compute[76815]: node.session.cmds_max = 128
Nov 14 22:25:51 user nova-compute[76815]: node.session.queue_depth = 32
Nov 14 22:25:51 user nova-compute[76815]: node.session.nr_sessions = 1
Nov 14 22:25:51 user nova-compute[76815]: node.session.auth.authmethod = CHAP
Nov 14 22:25:51 user nova-compute[76815]: node.session.auth.username = eUQZdafv
Nov 14 22:25:51 user nova-compute[76815]: node.session.auth.password = ***
Nov 14 22:25:51 user nova-compute[76815]: node.session.auth.username_in = <empty>
Nov 14 22:25:51 user nova-compute[76815]: node.session.auth.password_in = <empty>
Nov 14 22:25:51 user nova-compute[76815]: node.session.auth.chap_algs = MD5
Nov 14 22:25:51 user nova-compute[76815]: node.session.timeo.replacement_timeout = 120
Nov 14 22:25:51 user nova-compute[76815]: node.session.err_timeo.abort_timeout = 15
Nov 14 22:25:51 user nova-compute[76815]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 22:25:51 user nova-compute[76815]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 22:25:51 user nova-compute[76815]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.FastAbort = Yes
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.InitialR2T = No
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.ImmediateData = Yes
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.MaxConnections = 1
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 22:25:51 user nova-compute[76815]: node.session.iscsi.ERL = 0
Nov 14 22:25:51 user nova-compute[76815]: node.session.scan = manual
Nov 14 22:25:51 user nova-compute[76815]: node.session.reopen_max = 0
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].address = 172.16.0.220
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].port = 3260
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].startup = manual
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].tcp.window_size = 524288
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].tcp.type_of_service = 0
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].timeo.logout_timeout = 15
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].timeo.login_timeout = 15
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].timeo.auth_timeout = 45
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].iscsi.DataDigest = None
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].iscsi.IFMarker = No
Nov 14 22:25:51 user nova-compute[76815]: node.conn[0].iscsi.OFMarker = No
Nov 14 22:25:51 user nova-compute[76815]: # END RECORD
Nov 14 22:25:51 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d67381-cb47-4185-b5f2-75b73f8b6057]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48b0965-d1b1-42c2-a534-4709e59a27d9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUQZdafv {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUQZdafv" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14f510-67a9-4bf8-87bf-3ffab5827e27]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eUQZdafv'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ba23d0-80d5-4e98-b1ab-51529de7668c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[25415445-6b4b-4efa-8b09-ed4678240707]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:25:51 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:25:51 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:25:51 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:25:51 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:25:51 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:25:51 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:25:51 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:25:51 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] HCTL ('33', '0', '0', 0) found on session 40 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fadb6a-2d65-4550-b2f3-7c66a524f17a]: (4, ('0 0 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Searching for a device in session 40 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQZdafv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '23532303665366331', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532303665366331', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1524441459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1524441459',id=34,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-sahpvd6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:24:12Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=6bf4d919-7b71-4a01-8f73-f23f5ba76526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "vif_mac": "fa:16:3e:82:15:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "vif_mac": "fa:16:3e:82:15:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=f2cbfde8-95a0-4602-9b7a-bb86e213a377,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cbfde8-95') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.objects.base [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Object Instance<6bf4d919-7b71-4a01-8f73-f23f5ba76526> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:25:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:25:51 user nova-compute[76815]:   <uuid>6bf4d919-7b71-4a01-8f73-f23f5ba76526</uuid>
Nov 14 22:25:51 user nova-compute[76815]:   <name>instance-00000022</name>
Nov 14 22:25:51 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:25:51 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:25:51 user nova-compute[76815]:   <metadata>
Nov 14 22:25:51 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:25:51 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:25:51 user nova-compute[76815]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1524441459</nova:name>
Nov 14 22:25:51 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:25:51</nova:creationTime>
Nov 14 22:25:51 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:25:51 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:25:51 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:25:51 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:25:51 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:25:51 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:25:51 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:25:51 user nova-compute[76815]:       <nova:owner>
Nov 14 22:25:51 user nova-compute[76815]:         <nova:user uuid="a6ef0744ff3b459b9e32404ec12bbe55">tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member</nova:user>
Nov 14 22:25:51 user nova-compute[76815]:         <nova:project uuid="327b9fb17cb74bb0a56380b0d084cec3">tempest-ServerBootFromVolumeStableRescueTest-890378304</nova:project>
Nov 14 22:25:51 user nova-compute[76815]:       </nova:owner>
Nov 14 22:25:51 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:25:51 user nova-compute[76815]:       <nova:ports>
Nov 14 22:25:51 user nova-compute[76815]:         <nova:port uuid="f2cbfde8-95a0-4602-9b7a-bb86e213a377">
Nov 14 22:25:51 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:25:51 user nova-compute[76815]:         </nova:port>
Nov 14 22:25:51 user nova-compute[76815]:       </nova:ports>
Nov 14 22:25:51 user nova-compute[76815]:     </nova:instance>
Nov 14 22:25:51 user nova-compute[76815]:   </metadata>
Nov 14 22:25:51 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:25:51 user nova-compute[76815]:     <system>
Nov 14 22:25:51 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:25:51 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:25:51 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:25:51 user nova-compute[76815]:       <entry name="serial">6bf4d919-7b71-4a01-8f73-f23f5ba76526</entry>
Nov 14 22:25:51 user nova-compute[76815]:       <entry name="uuid">6bf4d919-7b71-4a01-8f73-f23f5ba76526</entry>
Nov 14 22:25:51 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:25:51 user nova-compute[76815]:     </system>
Nov 14 22:25:51 user nova-compute[76815]:   </sysinfo>
Nov 14 22:25:51 user nova-compute[76815]:   <os>
Nov 14 22:25:51 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:25:51 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:25:51 user nova-compute[76815]:   </os>
Nov 14 22:25:51 user nova-compute[76815]:   <features>
Nov 14 22:25:51 user nova-compute[76815]:     <acpi/>
Nov 14 22:25:51 user nova-compute[76815]:     <apic/>
Nov 14 22:25:51 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:25:51 user nova-compute[76815]:   </features>
Nov 14 22:25:51 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:25:51 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:25:51 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:25:51 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:25:51 user nova-compute[76815]:   </clock>
Nov 14 22:25:51 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:25:51 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:25:51 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:25:51 user nova-compute[76815]:   </cpu>
Nov 14 22:25:51 user nova-compute[76815]:   <devices>
Nov 14 22:25:51 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:25:51 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:25:51 user nova-compute[76815]:       <source dev="/dev/sdb"/>
Nov 14 22:25:51 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:25:51 user nova-compute[76815]:       <serial>b322f8f6-b262-4a1d-a26a-e74aa9ee748a</serial>
Nov 14 22:25:51 user nova-compute[76815]:     </disk>
Nov 14 22:25:51 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:25:51 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:25:51 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.rescue"/>
Nov 14 22:25:51 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:25:51 user nova-compute[76815]:       <boot order="1"/>
Nov 14 22:25:51 user nova-compute[76815]:     </disk>
Nov 14 22:25:51 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:25:51 user nova-compute[76815]:       <mac address="fa:16:3e:82:15:5a"/>
Nov 14 22:25:51 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:25:51 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:25:51 user nova-compute[76815]:       <target dev="tapf2cbfde8-95"/>
Nov 14 22:25:51 user nova-compute[76815]:     </interface>
Nov 14 22:25:51 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:25:51 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/console.log" append="off"/>
Nov 14 22:25:51 user nova-compute[76815]:     </serial>
Nov 14 22:25:51 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:25:51 user nova-compute[76815]:     <video>
Nov 14 22:25:51 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:25:51 user nova-compute[76815]:     </video>
Nov 14 22:25:51 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:25:51 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:25:51 user nova-compute[76815]:     </rng>
Nov 14 22:25:51 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:25:51 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:25:51 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:25:51 user nova-compute[76815]:     </memballoon>
Nov 14 22:25:51 user nova-compute[76815]:   </devices>
Nov 14 22:25:51 user nova-compute[76815]: </domain>
Nov 14 22:25:51 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:25:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Instance destroyed successfully.
Nov 14 22:25:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:25:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:25:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] No VIF found with MAC fa:16:3e:82:15:5a, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-67215b8e-885e-42d5-a809-00097762adb3 req-95ad857e-8f29-4c82-ab74-1757a20a0688 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-67215b8e-885e-42d5-a809-00097762adb3 req-95ad857e-8f29-4c82-ab74-1757a20a0688 service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-67215b8e-885e-42d5-a809-00097762adb3 req-95ad857e-8f29-4c82-ab74-1757a20a0688 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-67215b8e-885e-42d5-a809-00097762adb3 req-95ad857e-8f29-4c82-ab74-1757a20a0688 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-67215b8e-885e-42d5-a809-00097762adb3 req-95ad857e-8f29-4c82-ab74-1757a20a0688 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:25:53 user nova-compute[76815]: WARNING nova.compute.manager [req-67215b8e-885e-42d5-a809-00097762adb3 req-95ad857e-8f29-4c82-ab74-1757a20a0688 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state active and task_state rescuing.
Nov 14 22:25:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Going to confirm migration 2 {{(pid=76815) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-469618d8-92d9-4f30-9260-3baefbf7a79f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquired lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG nova.network.neutron [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'info_cache' on Instance uuid 3d82c8bf-899a-4e18-9738-8b6d067867bf {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-05c1119c-cd89-467d-9bc1-b1229172b28b req-5eaff6bb-1e36-42cd-9961-a404d21dce2d service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-05c1119c-cd89-467d-9bc1-b1229172b28b req-5eaff6bb-1e36-42cd-9961-a404d21dce2d service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-05c1119c-cd89-467d-9bc1-b1229172b28b req-5eaff6bb-1e36-42cd-9961-a404d21dce2d service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-05c1119c-cd89-467d-9bc1-b1229172b28b req-5eaff6bb-1e36-42cd-9961-a404d21dce2d service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-05c1119c-cd89-467d-9bc1-b1229172b28b req-5eaff6bb-1e36-42cd-9961-a404d21dce2d service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:25:55 user nova-compute[76815]: WARNING nova.compute.manager [req-05c1119c-cd89-467d-9bc1-b1229172b28b req-5eaff6bb-1e36-42cd-9961-a404d21dce2d service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state active and task_state rescuing.
Nov 14 22:25:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG nova.network.neutron [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating instance_info_cache with network_info: [{"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Releasing lock "refresh_cache-3d82c8bf-899a-4e18-9738-8b6d067867bf" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'migration_context' on Instance uuid 3d82c8bf-899a-4e18-9738-8b6d067867bf {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG nova.objects.base [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Object Instance<3d82c8bf-899a-4e18-9738-8b6d067867bf> lazy-loaded attributes: info_cache,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:25:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:25:56 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:25:56 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:25:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.362s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:56 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Deleted allocation for migration 3b7a8642-d37b-4073-b59c-4157768f0cea
Nov 14 22:25:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b2826222-7a86-4ef1-b02c-865acd0920a0 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.206s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:25:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-1c7daeeb-44d3-450f-be08-ebb8c46bd1ab req-a35428c4-04fb-4805-9ac2-e5ce776af57d service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received event network-changed-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:26:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-1c7daeeb-44d3-450f-be08-ebb8c46bd1ab req-a35428c4-04fb-4805-9ac2-e5ce776af57d service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Refreshing instance network info cache due to event network-changed-1b25b7b1-c714-4772-91f1-4936cd9180af. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:26:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c7daeeb-44d3-450f-be08-ebb8c46bd1ab req-a35428c4-04fb-4805-9ac2-e5ce776af57d service nova] Acquiring lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:26:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c7daeeb-44d3-450f-be08-ebb8c46bd1ab req-a35428c4-04fb-4805-9ac2-e5ce776af57d service nova] Acquired lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:26:20 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c7daeeb-44d3-450f-be08-ebb8c46bd1ab req-a35428c4-04fb-4805-9ac2-e5ce776af57d service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Refreshing network info cache for port 1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:26:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:20 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c7daeeb-44d3-450f-be08-ebb8c46bd1ab req-a35428c4-04fb-4805-9ac2-e5ce776af57d service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Updated VIF entry in instance network info cache for port 1b25b7b1-c714-4772-91f1-4936cd9180af. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:26:20 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c7daeeb-44d3-450f-be08-ebb8c46bd1ab req-a35428c4-04fb-4805-9ac2-e5ce776af57d service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Updating instance_info_cache with network_info: [{"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:26:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c7daeeb-44d3-450f-be08-ebb8c46bd1ab req-a35428c4-04fb-4805-9ac2-e5ce776af57d service nova] Releasing lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:26:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "3bd5952b-69ca-4685-88bc-5fc6762577d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:26:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:26:24 user nova-compute[76815]: INFO nova.compute.claims [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Claim successful on node user
Nov 14 22:26:25 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:26:25 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:26:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG nova.policy [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0fd5c7c940b0429994db55b93cb421ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673708a9f12541f6929c86eb60ca83c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:26:25 user nova-compute[76815]: INFO nova.virt.block_device [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Booting with volume 8c926e1d-ddc1-4d10-8120-ba9fc5283e0a at /dev/vda
Nov 14 22:26:25 user nova-compute[76815]: DEBUG os_brick.utils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3303e7-7896-4d3e-bfc6-04f3eee847f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26b82de-354f-4550-b573-d764a0d63040]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fc6ab5-12fc-4f0b-a865-3f1831316302]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1025eb0-f4d0-4b48-ae66-0a04d4789c13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:26:25 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:26:25 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[520832f9-40ae-4904-8744-7386e80c2246]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG os_brick.utils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Updating existing volume attachment record: 7084598e-7aa0-42ff-8cbe-422208093b69 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:26:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:26 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Successfully created port: b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Successfully updated port: b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquired lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-f9d081f7-27b1-488f-8a08-a213230c93a8 req-404cbfa3-216f-4c5b-a8cd-f8348cf5e81b service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received event network-changed-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.compute.manager [req-f9d081f7-27b1-488f-8a08-a213230c93a8 req-404cbfa3-216f-4c5b-a8cd-f8348cf5e81b service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Refreshing instance network info cache due to event network-changed-b1bbe11d-31b8-44ef-9885-2f8b702ad498. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f9d081f7-27b1-488f-8a08-a213230c93a8 req-404cbfa3-216f-4c5b-a8cd-f8348cf5e81b service nova] Acquiring lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Updating instance_info_cache with network_info: [{"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Releasing lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Instance network_info: |[{"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f9d081f7-27b1-488f-8a08-a213230c93a8 req-404cbfa3-216f-4c5b-a8cd-f8348cf5e81b service nova] Acquired lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.network.neutron [req-f9d081f7-27b1-488f-8a08-a213230c93a8 req-404cbfa3-216f-4c5b-a8cd-f8348cf5e81b service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Refreshing network info cache for port b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.network.neutron [req-f9d081f7-27b1-488f-8a08-a213230c93a8 req-404cbfa3-216f-4c5b-a8cd-f8348cf5e81b service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Updated VIF entry in instance network info cache for port b1bbe11d-31b8-44ef-9885-2f8b702ad498. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG nova.network.neutron [req-f9d081f7-27b1-488f-8a08-a213230c93a8 req-404cbfa3-216f-4c5b-a8cd-f8348cf5e81b service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Updating instance_info_cache with network_info: [{"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:26:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f9d081f7-27b1-488f-8a08-a213230c93a8 req-404cbfa3-216f-4c5b-a8cd-f8348cf5e81b service nova] Releasing lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:26:30 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Creating image(s)
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Did not create local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Ensure instance console log exists: /opt/stack/data/nova/instances/3bd5952b-69ca-4685-88bc-5fc6762577d2/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Start _get_guest_xml network_info=[{"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXfNHhDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3bd5952b-69ca-4685-88bc-5fc6762577d2', 'attached_at': '', 'detached_at': '', 'volume_id': '8c926e1d-ddc1-4d10-8120-ba9fc5283e0a', 'serial': '8c926e1d-ddc1-4d10-8120-ba9fc5283e0a'}, 'attachment_id': '7084598e-7aa0-42ff-8cbe-422208093b69', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:26:30 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:26:30 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXfNHhDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:26:30 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:26:30 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:26:30 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5370583-e311-4b8a-aa89-ccef727e57f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:26:30 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f288be-e43e-4420-abcd-6f9d32e8f67f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a] added
Nov 14 22:26:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d601625-4d5b-4d8a-97dd-d2c9c0054ee3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d938cd1-25e3-4715-aeba-2931580d0e04]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXfNHhDj {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXfNHhDj" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e8ff58-286a-45a5-9a66-95cad7f999f8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WXfNHhDj'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c2d018-e291-4877-a48b-b5fd009f0fe1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab4d91e-e4cf-4d1f-a4b2-ac2526e3dbe0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c422e1-d493-49f0-a119-aa216175a79a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a, portal: 172.16.0.220,3260]
Nov 14 22:26:30 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a, portal: 172.16.0.220,3260] successful.
Nov 14 22:26:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b70304d-f9ba-4fc7-a134-778e58585593]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ee6944-61f3-44ee-9f4b-2eec326e3694]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a (non-flash)
Nov 14 22:26:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bccb8d-87c1-4e7e-9185-279a631377d9]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:26:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXfNHhDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26466333939313231', 'path': '/dev/sdf'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466333939313231', 'path': '/dev/sdf'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1292441469',display_name='tempest-TestVolumeBootPattern-server-1292441469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1292441469',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVEyUh19O0alKw62tv3KmxoqsN7lyGaF0+P2xIoHxT+cKRRBx4MW7gidGmxry5UdKm4qrUC1sXQJe9NOXzjEcpENxKgmVXT2xLtMcWY8QrB8wG3DfxFfdkpczVqlfoPA==',key_name='tempest-TestVolumeBootPattern-1688630530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-omjtg9fl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:26:25Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=3bd5952b-69ca-4685-88bc-5fc6762577d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c9:d8,bridge_name='br-int',has_traffic_filtering=True,id=b1bbe11d-31b8-44ef-9885-2f8b702ad498,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bbe11d-31') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bd5952b-69ca-4685-88bc-5fc6762577d2 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:26:31 user nova-compute[76815]:   <uuid>3bd5952b-69ca-4685-88bc-5fc6762577d2</uuid>
Nov 14 22:26:31 user nova-compute[76815]:   <name>instance-00000026</name>
Nov 14 22:26:31 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:26:31 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:26:31 user nova-compute[76815]:   <metadata>
Nov 14 22:26:31 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:26:31 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:26:31 user nova-compute[76815]:       <nova:name>tempest-TestVolumeBootPattern-server-1292441469</nova:name>
Nov 14 22:26:31 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:26:30</nova:creationTime>
Nov 14 22:26:31 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:26:31 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:26:31 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:26:31 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:26:31 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:26:31 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:26:31 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:26:31 user nova-compute[76815]:       <nova:owner>
Nov 14 22:26:31 user nova-compute[76815]:         <nova:user uuid="0fd5c7c940b0429994db55b93cb421ed">tempest-TestVolumeBootPattern-1821264948-project-member</nova:user>
Nov 14 22:26:31 user nova-compute[76815]:         <nova:project uuid="673708a9f12541f6929c86eb60ca83c8">tempest-TestVolumeBootPattern-1821264948</nova:project>
Nov 14 22:26:31 user nova-compute[76815]:       </nova:owner>
Nov 14 22:26:31 user nova-compute[76815]:       <nova:ports>
Nov 14 22:26:31 user nova-compute[76815]:         <nova:port uuid="b1bbe11d-31b8-44ef-9885-2f8b702ad498">
Nov 14 22:26:31 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 22:26:31 user nova-compute[76815]:         </nova:port>
Nov 14 22:26:31 user nova-compute[76815]:       </nova:ports>
Nov 14 22:26:31 user nova-compute[76815]:     </nova:instance>
Nov 14 22:26:31 user nova-compute[76815]:   </metadata>
Nov 14 22:26:31 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:26:31 user nova-compute[76815]:     <system>
Nov 14 22:26:31 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:26:31 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:26:31 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:26:31 user nova-compute[76815]:       <entry name="serial">3bd5952b-69ca-4685-88bc-5fc6762577d2</entry>
Nov 14 22:26:31 user nova-compute[76815]:       <entry name="uuid">3bd5952b-69ca-4685-88bc-5fc6762577d2</entry>
Nov 14 22:26:31 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:26:31 user nova-compute[76815]:     </system>
Nov 14 22:26:31 user nova-compute[76815]:   </sysinfo>
Nov 14 22:26:31 user nova-compute[76815]:   <os>
Nov 14 22:26:31 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:26:31 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:26:31 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:26:31 user nova-compute[76815]:   </os>
Nov 14 22:26:31 user nova-compute[76815]:   <features>
Nov 14 22:26:31 user nova-compute[76815]:     <acpi/>
Nov 14 22:26:31 user nova-compute[76815]:     <apic/>
Nov 14 22:26:31 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:26:31 user nova-compute[76815]:   </features>
Nov 14 22:26:31 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:26:31 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:26:31 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:26:31 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:26:31 user nova-compute[76815]:   </clock>
Nov 14 22:26:31 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:26:31 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:26:31 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:26:31 user nova-compute[76815]:   </cpu>
Nov 14 22:26:31 user nova-compute[76815]:   <devices>
Nov 14 22:26:31 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:26:31 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:26:31 user nova-compute[76815]:       <source dev="/dev/sdf"/>
Nov 14 22:26:31 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:26:31 user nova-compute[76815]:       <serial>8c926e1d-ddc1-4d10-8120-ba9fc5283e0a</serial>
Nov 14 22:26:31 user nova-compute[76815]:     </disk>
Nov 14 22:26:31 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:26:31 user nova-compute[76815]:       <mac address="fa:16:3e:b4:c9:d8"/>
Nov 14 22:26:31 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:26:31 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:26:31 user nova-compute[76815]:       <target dev="tapb1bbe11d-31"/>
Nov 14 22:26:31 user nova-compute[76815]:     </interface>
Nov 14 22:26:31 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:26:31 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/3bd5952b-69ca-4685-88bc-5fc6762577d2/console.log" append="off"/>
Nov 14 22:26:31 user nova-compute[76815]:     </serial>
Nov 14 22:26:31 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:26:31 user nova-compute[76815]:     <video>
Nov 14 22:26:31 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:26:31 user nova-compute[76815]:     </video>
Nov 14 22:26:31 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:26:31 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:26:31 user nova-compute[76815]:     </rng>
Nov 14 22:26:31 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:26:31 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:26:31 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:26:31 user nova-compute[76815]:     </memballoon>
Nov 14 22:26:31 user nova-compute[76815]:   </devices>
Nov 14 22:26:31 user nova-compute[76815]: </domain>
Nov 14 22:26:31 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1292441469',display_name='tempest-TestVolumeBootPattern-server-1292441469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1292441469',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVEyUh19O0alKw62tv3KmxoqsN7lyGaF0+P2xIoHxT+cKRRBx4MW7gidGmxry5UdKm4qrUC1sXQJe9NOXzjEcpENxKgmVXT2xLtMcWY8QrB8wG3DfxFfdkpczVqlfoPA==',key_name='tempest-TestVolumeBootPattern-1688630530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-omjtg9fl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:26:25Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=3bd5952b-69ca-4685-88bc-5fc6762577d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c9:d8,bridge_name='br-int',has_traffic_filtering=True,id=b1bbe11d-31b8-44ef-9885-2f8b702ad498,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bbe11d-31') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG os_vif [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c9:d8,bridge_name='br-int',has_traffic_filtering=True,id=b1bbe11d-31b8-44ef-9885-2f8b702ad498,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bbe11d-31') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2ea879e-23dd-5e21-b724-02fe645552b2', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1bbe11d-31, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1bbe11d-31, col_values=(('qos', UUID('befe6957-b191-4b7a-a22a-58fe042a6406')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1bbe11d-31, col_values=(('external_ids', {'iface-id': 'b1bbe11d-31b8-44ef-9885-2f8b702ad498', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:c9:d8', 'vm-uuid': '3bd5952b-69ca-4685-88bc-5fc6762577d2'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:31 user nova-compute[76815]: INFO os_vif [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c9:d8,bridge_name='br-int',has_traffic_filtering=True,id=b1bbe11d-31b8-44ef-9885-2f8b702ad498,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bbe11d-31')
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:26:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] No VIF found with MAC fa:16:3e:b4:c9:d8, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:26:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-3e49edbc-cf70-49fc-a2f1-0fd1eb066c4d req-89ab5c18-49c8-441f-a9ce-433c8c8686b5 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received event network-vif-plugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:26:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3e49edbc-cf70-49fc-a2f1-0fd1eb066c4d req-89ab5c18-49c8-441f-a9ce-433c8c8686b5 service nova] Acquiring lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3e49edbc-cf70-49fc-a2f1-0fd1eb066c4d req-89ab5c18-49c8-441f-a9ce-433c8c8686b5 service nova] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3e49edbc-cf70-49fc-a2f1-0fd1eb066c4d req-89ab5c18-49c8-441f-a9ce-433c8c8686b5 service nova] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-3e49edbc-cf70-49fc-a2f1-0fd1eb066c4d req-89ab5c18-49c8-441f-a9ce-433c8c8686b5 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] No waiting events found dispatching network-vif-plugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:26:33 user nova-compute[76815]: WARNING nova.compute.manager [req-3e49edbc-cf70-49fc-a2f1-0fd1eb066c4d req-89ab5c18-49c8-441f-a9ce-433c8c8686b5 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received unexpected event network-vif-plugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 for instance with vm_state building and task_state spawning.
Nov 14 22:26:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:26:35 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Instance spawned successfully.
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-77eba5ef-1463-476d-ad37-ea8e76dd1444 req-000644fa-5a4d-4d76-88fc-8d323ba587d6 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received event network-vif-plugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-77eba5ef-1463-476d-ad37-ea8e76dd1444 req-000644fa-5a4d-4d76-88fc-8d323ba587d6 service nova] Acquiring lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-77eba5ef-1463-476d-ad37-ea8e76dd1444 req-000644fa-5a4d-4d76-88fc-8d323ba587d6 service nova] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-77eba5ef-1463-476d-ad37-ea8e76dd1444 req-000644fa-5a4d-4d76-88fc-8d323ba587d6 service nova] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-77eba5ef-1463-476d-ad37-ea8e76dd1444 req-000644fa-5a4d-4d76-88fc-8d323ba587d6 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] No waiting events found dispatching network-vif-plugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:26:35 user nova-compute[76815]: WARNING nova.compute.manager [req-77eba5ef-1463-476d-ad37-ea8e76dd1444 req-000644fa-5a4d-4d76-88fc-8d323ba587d6 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received unexpected event network-vif-plugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 for instance with vm_state building and task_state spawning.
Nov 14 22:26:35 user nova-compute[76815]: INFO nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 14 22:26:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:26:35 user nova-compute[76815]: INFO nova.compute.manager [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Took 10.62 seconds to build instance.
Nov 14 22:26:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e6c4fcf8-de6f-415c-8404-43129fa7154b tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.724s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-8a0ce0fd-7dee-4e38-b66e-a097cc2c62e3 req-c1ad7bc9-d382-4a6e-bd2d-286e57514bf1 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-changed-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:26:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-8a0ce0fd-7dee-4e38-b66e-a097cc2c62e3 req-c1ad7bc9-d382-4a6e-bd2d-286e57514bf1 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Refreshing instance network info cache due to event network-changed-26aeb0f8-3e23-4d18-946a-deec39e9788a. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:26:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8a0ce0fd-7dee-4e38-b66e-a097cc2c62e3 req-c1ad7bc9-d382-4a6e-bd2d-286e57514bf1 service nova] Acquiring lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:26:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8a0ce0fd-7dee-4e38-b66e-a097cc2c62e3 req-c1ad7bc9-d382-4a6e-bd2d-286e57514bf1 service nova] Acquired lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:26:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-8a0ce0fd-7dee-4e38-b66e-a097cc2c62e3 req-c1ad7bc9-d382-4a6e-bd2d-286e57514bf1 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Refreshing network info cache for port 26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:26:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-8a0ce0fd-7dee-4e38-b66e-a097cc2c62e3 req-c1ad7bc9-d382-4a6e-bd2d-286e57514bf1 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updated VIF entry in instance network info cache for port 26aeb0f8-3e23-4d18-946a-deec39e9788a. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:26:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-8a0ce0fd-7dee-4e38-b66e-a097cc2c62e3 req-c1ad7bc9-d382-4a6e-bd2d-286e57514bf1 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updating instance_info_cache with network_info: [{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:26:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8a0ce0fd-7dee-4e38-b66e-a097cc2c62e3 req-c1ad7bc9-d382-4a6e-bd2d-286e57514bf1 service nova] Releasing lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:26:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:39 user nova-compute[76815]: INFO nova.compute.manager [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Shelving
Nov 14 22:26:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-1063a1e6-511c-4e0b-b4a1-c12cf7c008cc req-023fa105-e0fc-40f9-9f45-d45e409001eb service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-unplugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:26:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1063a1e6-511c-4e0b-b4a1-c12cf7c008cc req-023fa105-e0fc-40f9-9f45-d45e409001eb service nova] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1063a1e6-511c-4e0b-b4a1-c12cf7c008cc req-023fa105-e0fc-40f9-9f45-d45e409001eb service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1063a1e6-511c-4e0b-b4a1-c12cf7c008cc req-023fa105-e0fc-40f9-9f45-d45e409001eb service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-1063a1e6-511c-4e0b-b4a1-c12cf7c008cc req-023fa105-e0fc-40f9-9f45-d45e409001eb service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] No waiting events found dispatching network-vif-unplugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:26:40 user nova-compute[76815]: WARNING nova.compute.manager [req-1063a1e6-511c-4e0b-b4a1-c12cf7c008cc req-023fa105-e0fc-40f9-9f45-d45e409001eb service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received unexpected event network-vif-unplugged-26aeb0f8-3e23-4d18-946a-deec39e9788a for instance with vm_state active and task_state shelving.
Nov 14 22:26:40 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance destroyed successfully.
Nov 14 22:26:40 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Beginning cold snapshot process
Nov 14 22:26:40 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:26:40 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk /opt/stack/data/nova/instances/snapshots/tmpx3btfhh5/e3e7c2ec21da4b1cae29f9039442928d {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk /opt/stack/data/nova/instances/snapshots/tmpx3btfhh5/e3e7c2ec21da4b1cae29f9039442928d" returned: 0 in 0.687s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:41 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Snapshot extracted, beginning image upload
Nov 14 22:26:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-e5f0263f-f977-4e06-b553-841c649d51b9 req-360790d9-90d3-4ee9-8198-7e1fad803833 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5f0263f-f977-4e06-b553-841c649d51b9 req-360790d9-90d3-4ee9-8198-7e1fad803833 service nova] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5f0263f-f977-4e06-b553-841c649d51b9 req-360790d9-90d3-4ee9-8198-7e1fad803833 service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5f0263f-f977-4e06-b553-841c649d51b9 req-360790d9-90d3-4ee9-8198-7e1fad803833 service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-e5f0263f-f977-4e06-b553-841c649d51b9 req-360790d9-90d3-4ee9-8198-7e1fad803833 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] No waiting events found dispatching network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:26:42 user nova-compute[76815]: WARNING nova.compute.manager [req-e5f0263f-f977-4e06-b553-841c649d51b9 req-360790d9-90d3-4ee9-8198-7e1fad803833 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received unexpected event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 22:26:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Snapshot image upload complete
Nov 14 22:26:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:26:44 user nova-compute[76815]: INFO nova.compute.manager [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Shelve offloading
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance destroyed successfully.
Nov 14 22:26:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquired lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:26:44 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:26:44 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:26:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=24.84786605834961GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updating instance_info_cache with network_info: [{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:26:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Releasing lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 6bf4d919-7b71-4a01-8f73-f23f5ba76526 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3d82c8bf-899a-4e18-9738-8b6d067867bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 5625e9a8-df68-4abb-a423-59143395837c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 6c5a15b3-6d75-459b-a379-b756124a9c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance e4583d20-0b4a-47fc-8ac0-75408503371e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3bd5952b-69ca-4685-88bc-5fc6762577d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance destroyed successfully.
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'resources' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:24:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-534347897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-534347897',id=36,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZILfldAReFZ5UtvJtfYXt/dkmY/wU8c/O723H+6gC1WF12YMQsz92HeN79HKXyOKV/c5QfCiehJOw5MxSa1EU1XguruLemXyjytD1YssyT5k8QEqVLL6jZBnY8qp3AnA==',key_name='tempest-keypair-621748568',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-tkwhh7x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member',shelved_at='2023-11-14T22:26:44.052993',shelved_host='user',shelved_image_id='bcd94bef-7c5b-4b99-91e6-8678ed31aa6e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:26:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=6c5a15b3-6d75-459b-a379-b756124a9c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG os_vif [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26aeb0f8-3e, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-ef817a1a-6371-4bd4-8a26-0266e25cba13 req-30b397a8-743d-4949-8277-8162b4ed0746 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-changed-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-ef817a1a-6371-4bd4-8a26-0266e25cba13 req-30b397a8-743d-4949-8277-8162b4ed0746 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Refreshing instance network info cache due to event network-changed-26aeb0f8-3e23-4d18-946a-deec39e9788a. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ef817a1a-6371-4bd4-8a26-0266e25cba13 req-30b397a8-743d-4949-8277-8162b4ed0746 service nova] Acquiring lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ef817a1a-6371-4bd4-8a26-0266e25cba13 req-30b397a8-743d-4949-8277-8162b4ed0746 service nova] Acquired lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-ef817a1a-6371-4bd4-8a26-0266e25cba13 req-30b397a8-743d-4949-8277-8162b4ed0746 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Refreshing network info cache for port 26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5279cfb9-e320-4b9a-bedc-a028eabddf9d) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:45 user nova-compute[76815]: INFO os_vif [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e')
Nov 14 22:26:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Deleting instance files /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29_del
Nov 14 22:26:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Deletion of /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29_del complete
Nov 14 22:26:45 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Deleted allocations for instance 6c5a15b3-6d75-459b-a379-b756124a9c29
Nov 14 22:26:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.objects.base [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<6c5a15b3-6d75-459b-a379-b756124a9c29> lazy-loaded attributes: resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-ef817a1a-6371-4bd4-8a26-0266e25cba13 req-30b397a8-743d-4949-8277-8162b4ed0746 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updated VIF entry in instance network info cache for port 26aeb0f8-3e23-4d18-946a-deec39e9788a. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:26:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-ef817a1a-6371-4bd4-8a26-0266e25cba13 req-30b397a8-743d-4949-8277-8162b4ed0746 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updating instance_info_cache with network_info: [{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ef817a1a-6371-4bd4-8a26-0266e25cba13 req-30b397a8-743d-4949-8277-8162b4ed0746 service nova] Releasing lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e1ba431d-4c26-4742-af45-71f621dcccf0 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.308s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:26:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updating instance_info_cache with network_info: [{"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-0ba89777-a1fe-4754-9f3b-4e7a2daaa550" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:26:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:26:50 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:26:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:26:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:26:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquiring lock "e4583d20-0b4a-47fc-8ac0-75408503371e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquiring lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:23 user nova-compute[76815]: INFO nova.compute.manager [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Terminating instance
Nov 14 22:27:23 user nova-compute[76815]: DEBUG nova.compute.manager [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-f97d3f29-4671-4d89-89f2-0fd604426e61 req-157f8bf7-97dd-4800-9cd0-566ce6f63e97 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received event network-vif-unplugged-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f97d3f29-4671-4d89-89f2-0fd604426e61 req-157f8bf7-97dd-4800-9cd0-566ce6f63e97 service nova] Acquiring lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f97d3f29-4671-4d89-89f2-0fd604426e61 req-157f8bf7-97dd-4800-9cd0-566ce6f63e97 service nova] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f97d3f29-4671-4d89-89f2-0fd604426e61 req-157f8bf7-97dd-4800-9cd0-566ce6f63e97 service nova] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-f97d3f29-4671-4d89-89f2-0fd604426e61 req-157f8bf7-97dd-4800-9cd0-566ce6f63e97 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] No waiting events found dispatching network-vif-unplugged-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-f97d3f29-4671-4d89-89f2-0fd604426e61 req-157f8bf7-97dd-4800-9cd0-566ce6f63e97 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received event network-vif-unplugged-51e84a81-4a71-4df3-a161-f4086f9223fd for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:27:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Instance destroyed successfully.
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.objects.instance [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lazy-loading 'resources' on Instance uuid e4583d20-0b4a-47fc-8ac0-75408503371e {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1148014441',display_name='tempest-VolumesNegativeTest-instance-1148014441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1148014441',id=37,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0bd4f206f9904de3bbeab0472dd431a7',ramdisk_id='',reservation_id='r-70okrppk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1092805728',owner_user_name='tempest-VolumesNegativeTest-1092805728-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:25:39Z,user_data=None,user_id='52500233058942f2af786a1c5e29c0a9',uuid=e4583d20-0b4a-47fc-8ac0-75408503371e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Converting VIF {"id": "51e84a81-4a71-4df3-a161-f4086f9223fd", "address": "fa:16:3e:63:96:40", "network": {"id": "1f44c72a-4877-41b0-b19d-905ff0aa6c1a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "04d44a937240472985dfffe4a6ab1306", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e84a81-4a", "ovs_interfaceid": "51e84a81-4a71-4df3-a161-f4086f9223fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:96:40,bridge_name='br-int',has_traffic_filtering=True,id=51e84a81-4a71-4df3-a161-f4086f9223fd,network=Network(1f44c72a-4877-41b0-b19d-905ff0aa6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e84a81-4a') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG os_vif [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:96:40,bridge_name='br-int',has_traffic_filtering=True,id=51e84a81-4a71-4df3-a161-f4086f9223fd,network=Network(1f44c72a-4877-41b0-b19d-905ff0aa6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e84a81-4a') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51e84a81-4a, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a632822-fb3c-491b-a299-cbc705d6049d) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:27:24 user nova-compute[76815]: INFO os_vif [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:96:40,bridge_name='br-int',has_traffic_filtering=True,id=51e84a81-4a71-4df3-a161-f4086f9223fd,network=Network(1f44c72a-4877-41b0-b19d-905ff0aa6c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e84a81-4a')
Nov 14 22:27:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Deleting instance files /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e_del
Nov 14 22:27:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Deletion of /opt/stack/data/nova/instances/e4583d20-0b4a-47fc-8ac0-75408503371e_del complete
Nov 14 22:27:24 user nova-compute[76815]: INFO nova.compute.manager [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 22:27:24 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:27:24 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Took 0.42 seconds to deallocate network for instance.
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-970f7b89-befa-4e6d-bfd4-c740d4da4e9c req-01e39071-2710-4631-bc08-020b57135cb9 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received event network-vif-deleted-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:27:24 user nova-compute[76815]: INFO nova.compute.manager [req-970f7b89-befa-4e6d-bfd4-c740d4da4e9c req-01e39071-2710-4631-bc08-020b57135cb9 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Neutron deleted interface 51e84a81-4a71-4df3-a161-f4086f9223fd; detaching it from the instance and deleting it from the info cache
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.network.neutron [req-970f7b89-befa-4e6d-bfd4-c740d4da4e9c req-01e39071-2710-4631-bc08-020b57135cb9 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-970f7b89-befa-4e6d-bfd4-c740d4da4e9c req-01e39071-2710-4631-bc08-020b57135cb9 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Detach interface failed, port_id=51e84a81-4a71-4df3-a161-f4086f9223fd, reason: Instance e4583d20-0b4a-47fc-8ac0-75408503371e could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:25 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:27:25 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:27:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:25 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Deleted allocations for instance e4583d20-0b4a-47fc-8ac0-75408503371e
Nov 14 22:27:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-15973867-126c-442e-99c3-581017accdc0 tempest-VolumesNegativeTest-1092805728 tempest-VolumesNegativeTest-1092805728-project-member] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.767s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-1324ab1c-2c47-4c81-8927-7037d3812db4 req-040657c4-82a7-4620-b5b3-45ee333cdd86 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received event network-vif-plugged-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:27:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1324ab1c-2c47-4c81-8927-7037d3812db4 req-040657c4-82a7-4620-b5b3-45ee333cdd86 service nova] Acquiring lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1324ab1c-2c47-4c81-8927-7037d3812db4 req-040657c4-82a7-4620-b5b3-45ee333cdd86 service nova] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1324ab1c-2c47-4c81-8927-7037d3812db4 req-040657c4-82a7-4620-b5b3-45ee333cdd86 service nova] Lock "e4583d20-0b4a-47fc-8ac0-75408503371e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-1324ab1c-2c47-4c81-8927-7037d3812db4 req-040657c4-82a7-4620-b5b3-45ee333cdd86 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] No waiting events found dispatching network-vif-plugged-51e84a81-4a71-4df3-a161-f4086f9223fd {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:27:25 user nova-compute[76815]: WARNING nova.compute.manager [req-1324ab1c-2c47-4c81-8927-7037d3812db4 req-040657c4-82a7-4620-b5b3-45ee333cdd86 service nova] [instance: e4583d20-0b4a-47fc-8ac0-75408503371e] Received unexpected event network-vif-plugged-51e84a81-4a71-4df3-a161-f4086f9223fd for instance with vm_state deleted and task_state None.
Nov 14 22:27:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:38 user nova-compute[76815]: INFO nova.compute.manager [None req-29e75202-f323-46b4-b8e0-a526a27ffa8f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Unrescuing
Nov 14 22:27:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29e75202-f323-46b4-b8e0-a526a27ffa8f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:27:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29e75202-f323-46b4-b8e0-a526a27ffa8f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquired lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:27:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-29e75202-f323-46b4-b8e0-a526a27ffa8f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:27:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-29e75202-f323-46b4-b8e0-a526a27ffa8f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updating instance_info_cache with network_info: [{"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:27:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29e75202-f323-46b4-b8e0-a526a27ffa8f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Releasing lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:27:38 user nova-compute[76815]: DEBUG nova.objects.instance [None req-29e75202-f323-46b4-b8e0-a526a27ffa8f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'flavor' on Instance uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:27:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-5e66affa-eeb2-4577-8808-f1b37ee9737b req-405229d0-1258-4576-a21b-d7de5295f78b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-unplugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:27:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5e66affa-eeb2-4577-8808-f1b37ee9737b req-405229d0-1258-4576-a21b-d7de5295f78b service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5e66affa-eeb2-4577-8808-f1b37ee9737b req-405229d0-1258-4576-a21b-d7de5295f78b service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5e66affa-eeb2-4577-8808-f1b37ee9737b req-405229d0-1258-4576-a21b-d7de5295f78b service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-5e66affa-eeb2-4577-8808-f1b37ee9737b req-405229d0-1258-4576-a21b-d7de5295f78b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-unplugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:27:39 user nova-compute[76815]: WARNING nova.compute.manager [req-5e66affa-eeb2-4577-8808-f1b37ee9737b req-405229d0-1258-4576-a21b-d7de5295f78b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-unplugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:27:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:39 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Instance destroyed successfully.
Nov 14 22:27:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-4a923de2-e839-46a2-85df-d0ac2935368a req-14f32e7f-1396-4756-837f-f0dc870a62de service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4a923de2-e839-46a2-85df-d0ac2935368a req-14f32e7f-1396-4756-837f-f0dc870a62de service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4a923de2-e839-46a2-85df-d0ac2935368a req-14f32e7f-1396-4756-837f-f0dc870a62de service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4a923de2-e839-46a2-85df-d0ac2935368a req-14f32e7f-1396-4756-837f-f0dc870a62de service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-4a923de2-e839-46a2-85df-d0ac2935368a req-14f32e7f-1396-4756-837f-f0dc870a62de service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:27:41 user nova-compute[76815]: WARNING nova.compute.manager [req-4a923de2-e839-46a2-85df-d0ac2935368a req-14f32e7f-1396-4756-837f-f0dc870a62de service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:27:42 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:42 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:27:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-29e75202-f323-46b4-b8e0-a526a27ffa8f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:27:43 user nova-compute[76815]: WARNING nova.compute.manager [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state active and task_state None.
Nov 14 22:27:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:27:43 user nova-compute[76815]: WARNING nova.compute.manager [req-eec5fa9e-bb1d-4637-a308-b7ae6e72dc40 req-64bb5ce5-52f4-48cd-b2a3-7b0335d351f4 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state active and task_state None.
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:27:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:27:44 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:27:44 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8200MB free_disk=24.90213394165039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 6bf4d919-7b71-4a01-8f73-f23f5ba76526 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3d82c8bf-899a-4e18-9738-8b6d067867bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 5625e9a8-df68-4abb-a423-59143395837c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3bd5952b-69ca-4685-88bc-5fc6762577d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:27:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:27:45 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:27:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:27:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:27:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:27:46 user nova-compute[76815]: INFO nova.compute.manager [None req-e72686b1-460c-4e5f-8493-4b540c74741c tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Get console output
Nov 14 22:27:46 user nova-compute[76815]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 22:27:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Updating instance_info_cache with network_info: [{"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:27:48 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:54 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:27:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:27:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:27:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:27:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:27:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:27:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-2e378092-287d-49af-9bd3-8d5b13f02601 req-838c01d3-eb7a-44ae-8cfd-8e133f4888b7 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received event network-changed-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-2e378092-287d-49af-9bd3-8d5b13f02601 req-838c01d3-eb7a-44ae-8cfd-8e133f4888b7 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Refreshing instance network info cache due to event network-changed-b1bbe11d-31b8-44ef-9885-2f8b702ad498. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:28:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e378092-287d-49af-9bd3-8d5b13f02601 req-838c01d3-eb7a-44ae-8cfd-8e133f4888b7 service nova] Acquiring lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:28:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e378092-287d-49af-9bd3-8d5b13f02601 req-838c01d3-eb7a-44ae-8cfd-8e133f4888b7 service nova] Acquired lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:28:16 user nova-compute[76815]: DEBUG nova.network.neutron [req-2e378092-287d-49af-9bd3-8d5b13f02601 req-838c01d3-eb7a-44ae-8cfd-8e133f4888b7 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Refreshing network info cache for port b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:28:16 user nova-compute[76815]: DEBUG nova.network.neutron [req-2e378092-287d-49af-9bd3-8d5b13f02601 req-838c01d3-eb7a-44ae-8cfd-8e133f4888b7 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Updated VIF entry in instance network info cache for port b1bbe11d-31b8-44ef-9885-2f8b702ad498. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:28:16 user nova-compute[76815]: DEBUG nova.network.neutron [req-2e378092-287d-49af-9bd3-8d5b13f02601 req-838c01d3-eb7a-44ae-8cfd-8e133f4888b7 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Updating instance_info_cache with network_info: [{"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:28:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2e378092-287d-49af-9bd3-8d5b13f02601 req-838c01d3-eb7a-44ae-8cfd-8e133f4888b7 service nova] Releasing lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-55997d5c-ac48-4bf5-9ae6-4bf95e0ffcb0 req-7c1105cb-d3a3-4651-ade5-bc754601a90e service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received event network-changed-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-55997d5c-ac48-4bf5-9ae6-4bf95e0ffcb0 req-7c1105cb-d3a3-4651-ade5-bc754601a90e service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Refreshing instance network info cache due to event network-changed-b1bbe11d-31b8-44ef-9885-2f8b702ad498. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55997d5c-ac48-4bf5-9ae6-4bf95e0ffcb0 req-7c1105cb-d3a3-4651-ade5-bc754601a90e service nova] Acquiring lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55997d5c-ac48-4bf5-9ae6-4bf95e0ffcb0 req-7c1105cb-d3a3-4651-ade5-bc754601a90e service nova] Acquired lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG nova.network.neutron [req-55997d5c-ac48-4bf5-9ae6-4bf95e0ffcb0 req-7c1105cb-d3a3-4651-ade5-bc754601a90e service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Refreshing network info cache for port b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "3bd5952b-69ca-4685-88bc-5fc6762577d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:17 user nova-compute[76815]: INFO nova.compute.manager [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Terminating instance
Nov 14 22:28:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.network.neutron [req-55997d5c-ac48-4bf5-9ae6-4bf95e0ffcb0 req-7c1105cb-d3a3-4651-ade5-bc754601a90e service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Updated VIF entry in instance network info cache for port b1bbe11d-31b8-44ef-9885-2f8b702ad498. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.network.neutron [req-55997d5c-ac48-4bf5-9ae6-4bf95e0ffcb0 req-7c1105cb-d3a3-4651-ade5-bc754601a90e service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Updating instance_info_cache with network_info: [{"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55997d5c-ac48-4bf5-9ae6-4bf95e0ffcb0 req-7c1105cb-d3a3-4651-ade5-bc754601a90e service nova] Releasing lock "refresh_cache-3bd5952b-69ca-4685-88bc-5fc6762577d2" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:28:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Instance destroyed successfully.
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.objects.instance [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'resources' on Instance uuid 3bd5952b-69ca-4685-88bc-5fc6762577d2 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1292441469',display_name='tempest-TestVolumeBootPattern-server-1292441469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1292441469',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVEyUh19O0alKw62tv3KmxoqsN7lyGaF0+P2xIoHxT+cKRRBx4MW7gidGmxry5UdKm4qrUC1sXQJe9NOXzjEcpENxKgmVXT2xLtMcWY8QrB8wG3DfxFfdkpczVqlfoPA==',key_name='tempest-TestVolumeBootPattern-1688630530',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:26:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-omjtg9fl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:26:35Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=3bd5952b-69ca-4685-88bc-5fc6762577d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "address": "fa:16:3e:b4:c9:d8", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1bbe11d-31", "ovs_interfaceid": "b1bbe11d-31b8-44ef-9885-2f8b702ad498", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:c9:d8,bridge_name='br-int',has_traffic_filtering=True,id=b1bbe11d-31b8-44ef-9885-2f8b702ad498,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bbe11d-31') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_vif [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:c9:d8,bridge_name='br-int',has_traffic_filtering=True,id=b1bbe11d-31b8-44ef-9885-2f8b702ad498,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bbe11d-31') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1bbe11d-31, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=befe6957-b191-4b7a-a22a-58fe042a6406) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:18 user nova-compute[76815]: INFO os_vif [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:c9:d8,bridge_name='br-int',has_traffic_filtering=True,id=b1bbe11d-31b8-44ef-9885-2f8b702ad498,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1bbe11d-31')
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXfNHhDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:28:18 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9374ae20-3c71-493a-b39f-e855cc15f2d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:28:18 user nova-compute[76815]: No targets found.
Nov 14 22:28:18 user nova-compute[76815]: iSNS:
Nov 14 22:28:18 user nova-compute[76815]: No targets found.
Nov 14 22:28:18 user nova-compute[76815]: STATIC:
Nov 14 22:28:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a
Nov 14 22:28:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:28:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:28:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:28:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:28:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:28:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a
Nov 14 22:28:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:28:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:28:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a
Nov 14 22:28:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:28:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:28:18 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c
Nov 14 22:28:18 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:28:18 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:28:18 user nova-compute[76815]: FIRMWARE:
Nov 14 22:28:18 user nova-compute[76815]: No targets found.
Nov 14 22:28:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:28:18 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:28:18 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b8c6b-7d34-446d-ad33-0cfde14e098d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3acf858-f7c4-4f06-8e64-de78e1187d67]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:28:18 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:28:18 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:28:18 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:28:18 user nova-compute[76815]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a (non-flash)
Nov 14 22:28:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:28:18 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:28:18 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:28:18 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:28:18 user nova-compute[76815]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a (non-flash)
Nov 14 22:28:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c846d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a'): ({'sdf'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Removing single pathed devices sdf {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90837c2-615e-4cbb-a5e8-323a5498b45b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f442ebfe-727c-4a2b-92dd-b638bfb1a4bf]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flushing IO for device /dev/sdf {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[91195a69-055b-48c1-bbd9-aa69f950632a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4005c63f-02c2-41d9-8b29-8363cde648f8]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] SCSI volumes sdf have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[61276881-7cfc-441c-af51-9556057f0f3d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received event network-vif-unplugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] Acquiring lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] No waiting events found dispatching network-vif-unplugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received event network-vif-unplugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received event network-vif-plugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] Acquiring lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.compute.manager [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] No waiting events found dispatching network-vif-plugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:28:18 user nova-compute[76815]: WARNING nova.compute.manager [req-d21298a3-1217-4744-ad39-d6364a1fc68e req-79e80560-01a3-43ec-9207-19a652567fe0 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received unexpected event network-vif-plugged-b1bbe11d-31b8-44ef-9885-2f8b702ad498 for instance with vm_state active and task_state deleting.
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75e72dc-7197-4b83-a24e-d56ddd8fb76a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a, portal: 172.16.0.220,3260]
Nov 14 22:28:18 user nova-compute[76815]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a, portal: 172.16.0.220,3260] successful.
Nov 14 22:28:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c926e1d-ddc1-4d10-8120-ba9fc5283e0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[540bc748-8440-49fb-be22-18667f529df8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== disconnect_volume: return (349ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:28:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Deleting instance files /opt/stack/data/nova/instances/3bd5952b-69ca-4685-88bc-5fc6762577d2_del
Nov 14 22:28:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Deletion of /opt/stack/data/nova/instances/3bd5952b-69ca-4685-88bc-5fc6762577d2_del complete
Nov 14 22:28:18 user nova-compute[76815]: INFO nova.compute.manager [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 22:28:18 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:28:18 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:28:19 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:28:19 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Took 0.41 seconds to deallocate network for instance.
Nov 14 22:28:19 user nova-compute[76815]: INFO nova.compute.manager [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Took 0.88 seconds to detach 1 volumes for instance.
Nov 14 22:28:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:20 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:28:20 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:28:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:20 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Deleted allocations for instance 3bd5952b-69ca-4685-88bc-5fc6762577d2
Nov 14 22:28:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8ac581fd-9b8a-403d-b67d-e6db45c24fcf tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "3bd5952b-69ca-4685-88bc-5fc6762577d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.972s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-7a5df7f2-6bb6-4159-a37d-d7ea68ddb0bf req-98ca302b-d2aa-435b-95bb-20494514b004 service nova] [instance: 3bd5952b-69ca-4685-88bc-5fc6762577d2] Received event network-vif-deleted-b1bbe11d-31b8-44ef-9885-2f8b702ad498 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:32 user nova-compute[76815]: INFO nova.compute.manager [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Unshelving
Nov 14 22:28:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:32 user nova-compute[76815]: DEBUG nova.objects.instance [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'pci_requests' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:28:32 user nova-compute[76815]: DEBUG nova.objects.instance [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:28:32 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:28:32 user nova-compute[76815]: INFO nova.compute.claims [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Claim successful on node user
Nov 14 22:28:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:33 user nova-compute[76815]: INFO nova.network.neutron [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updating port 26aeb0f8-3e23-4d18-946a-deec39e9788a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquired lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG nova.network.neutron [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-c3f22b18-2fa8-4c6e-827e-f3810ff8d0a1 req-6620cd43-bfb2-4ffd-9098-0e3cc3e918c5 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-changed-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-c3f22b18-2fa8-4c6e-827e-f3810ff8d0a1 req-6620cd43-bfb2-4ffd-9098-0e3cc3e918c5 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Refreshing instance network info cache due to event network-changed-26aeb0f8-3e23-4d18-946a-deec39e9788a. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:28:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c3f22b18-2fa8-4c6e-827e-f3810ff8d0a1 req-6620cd43-bfb2-4ffd-9098-0e3cc3e918c5 service nova] Acquiring lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updating instance_info_cache with network_info: [{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Releasing lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:28:34 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Creating image(s)
Nov 14 22:28:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG nova.objects.instance [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c3f22b18-2fa8-4c6e-827e-f3810ff8d0a1 req-6620cd43-bfb2-4ffd-9098-0e3cc3e918c5 service nova] Acquired lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-c3f22b18-2fa8-4c6e-827e-f3810ff8d0a1 req-6620cd43-bfb2-4ffd-9098-0e3cc3e918c5 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Refreshing network info cache for port 26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG nova.objects.base [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<6c5a15b3-6d75-459b-a379-b756124a9c29> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "7aac9ce0664ab230553d7b3f86e23e7b23eba6c2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "7aac9ce0664ab230553d7b3f86e23e7b23eba6c2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2.part --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:35 user nova-compute[76815]: DEBUG nova.virt.images [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] bcd94bef-7c5b-4b99-91e6-8678ed31aa6e was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:28:35 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:28:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2.part /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-c3f22b18-2fa8-4c6e-827e-f3810ff8d0a1 req-6620cd43-bfb2-4ffd-9098-0e3cc3e918c5 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updated VIF entry in instance network info cache for port 26aeb0f8-3e23-4d18-946a-deec39e9788a. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:28:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-c3f22b18-2fa8-4c6e-827e-f3810ff8d0a1 req-6620cd43-bfb2-4ffd-9098-0e3cc3e918c5 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updating instance_info_cache with network_info: [{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:28:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c3f22b18-2fa8-4c6e-827e-f3810ff8d0a1 req-6620cd43-bfb2-4ffd-9098-0e3cc3e918c5 service nova] Releasing lock "refresh_cache-6c5a15b3-6d75-459b-a379-b756124a9c29" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2.part /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2.converted" returned: 0 in 0.691s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "7aac9ce0664ab230553d7b3f86e23e7b23eba6c2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.250s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2 --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "7aac9ce0664ab230553d7b3f86e23e7b23eba6c2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "7aac9ce0664ab230553d7b3f86e23e7b23eba6c2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2 --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:36 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2,backing_fmt=raw /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2,backing_fmt=raw /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk 1073741824" returned: 0 in 0.048s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "7aac9ce0664ab230553d7b3f86e23e7b23eba6c2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2 --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG nova.objects.instance [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'migration_context' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG nova.objects.base [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<6c5a15b3-6d75-459b-a379-b756124a9c29> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:28:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Rebasing disk image.
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b -F raw /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:37 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:28:37 user nova-compute[76815]: INFO nova.compute.claims [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Claim successful on node user
Nov 14 22:28:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:28:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:28:38 user nova-compute[76815]: DEBUG nova.policy [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f8e1c6f785d4f93ab73089de17904f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf640863b51d408cb9c9a0e94e7b77bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:28:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Creating image(s)
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "/opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "/opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "/opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.214s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.197s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk 1073741824" returned: 0 in 0.060s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Successfully created port: dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Cannot resize image /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Ensure instance console log exists: /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b -F raw /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk" returned: 0 in 2.114s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Ensure instance console log exists: /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Start _get_guest_xml network_info=[{"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='11f54ac1fbd15681761962ac35aa3e99',container_format='bare',created_at=2023-11-14T22:26:40Z,direct_url=<?>,disk_format='qcow2',id=bcd94bef-7c5b-4b99-91e6-8678ed31aa6e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-534347897-shelved',owner='4bad961b0e704e2483d2de3d382a23b6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T22:26:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:28:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:28:39 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='11f54ac1fbd15681761962ac35aa3e99',container_format='bare',created_at=2023-11-14T22:26:40Z,direct_url=<?>,disk_format='qcow2',id=bcd94bef-7c5b-4b99-91e6-8678ed31aa6e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-534347897-shelved',owner='4bad961b0e704e2483d2de3d382a23b6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T22:26:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.objects.instance [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.objects.base [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<6c5a15b3-6d75-459b-a379-b756124a9c29> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:24:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-534347897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-534347897',id=36,image_ref='bcd94bef-7c5b-4b99-91e6-8678ed31aa6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-621748568',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-tkwhh7x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member',shelved_at='2023-11-14T22:26:44.052993',shelved_host='user',shelved_image_id='bcd94bef-7c5b-4b99-91e6-8678ed31aa6e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=6c5a15b3-6d75-459b-a379-b756124a9c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.objects.instance [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.objects.base [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Object Instance<6c5a15b3-6d75-459b-a379-b756124a9c29> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:28:39 user nova-compute[76815]:   <uuid>6c5a15b3-6d75-459b-a379-b756124a9c29</uuid>
Nov 14 22:28:39 user nova-compute[76815]:   <name>instance-00000024</name>
Nov 14 22:28:39 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:28:39 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:28:39 user nova-compute[76815]:   <metadata>
Nov 14 22:28:39 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:28:39 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:28:39 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-534347897</nova:name>
Nov 14 22:28:39 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:28:39</nova:creationTime>
Nov 14 22:28:39 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:28:39 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:28:39 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:28:39 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:28:39 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:28:39 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:28:39 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:28:39 user nova-compute[76815]:       <nova:owner>
Nov 14 22:28:39 user nova-compute[76815]:         <nova:user uuid="50afb4444eea433ba80e4f4e84821101">tempest-AttachVolumeShelveTestJSON-1125875673-project-member</nova:user>
Nov 14 22:28:39 user nova-compute[76815]:         <nova:project uuid="4bad961b0e704e2483d2de3d382a23b6">tempest-AttachVolumeShelveTestJSON-1125875673</nova:project>
Nov 14 22:28:39 user nova-compute[76815]:       </nova:owner>
Nov 14 22:28:39 user nova-compute[76815]:       <nova:root type="image" uuid="bcd94bef-7c5b-4b99-91e6-8678ed31aa6e"/>
Nov 14 22:28:39 user nova-compute[76815]:       <nova:ports>
Nov 14 22:28:39 user nova-compute[76815]:         <nova:port uuid="26aeb0f8-3e23-4d18-946a-deec39e9788a">
Nov 14 22:28:39 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 22:28:39 user nova-compute[76815]:         </nova:port>
Nov 14 22:28:39 user nova-compute[76815]:       </nova:ports>
Nov 14 22:28:39 user nova-compute[76815]:     </nova:instance>
Nov 14 22:28:39 user nova-compute[76815]:   </metadata>
Nov 14 22:28:39 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:28:39 user nova-compute[76815]:     <system>
Nov 14 22:28:39 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:28:39 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:28:39 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:28:39 user nova-compute[76815]:       <entry name="serial">6c5a15b3-6d75-459b-a379-b756124a9c29</entry>
Nov 14 22:28:39 user nova-compute[76815]:       <entry name="uuid">6c5a15b3-6d75-459b-a379-b756124a9c29</entry>
Nov 14 22:28:39 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:28:39 user nova-compute[76815]:     </system>
Nov 14 22:28:39 user nova-compute[76815]:   </sysinfo>
Nov 14 22:28:39 user nova-compute[76815]:   <os>
Nov 14 22:28:39 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:28:39 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:28:39 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:28:39 user nova-compute[76815]:   </os>
Nov 14 22:28:39 user nova-compute[76815]:   <features>
Nov 14 22:28:39 user nova-compute[76815]:     <acpi/>
Nov 14 22:28:39 user nova-compute[76815]:     <apic/>
Nov 14 22:28:39 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:28:39 user nova-compute[76815]:   </features>
Nov 14 22:28:39 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:28:39 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:28:39 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:28:39 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:28:39 user nova-compute[76815]:   </clock>
Nov 14 22:28:39 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:28:39 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:28:39 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:28:39 user nova-compute[76815]:   </cpu>
Nov 14 22:28:39 user nova-compute[76815]:   <devices>
Nov 14 22:28:39 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:28:39 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:28:39 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk"/>
Nov 14 22:28:39 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:28:39 user nova-compute[76815]:     </disk>
Nov 14 22:28:39 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:28:39 user nova-compute[76815]:       <mac address="fa:16:3e:59:87:4f"/>
Nov 14 22:28:39 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:28:39 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:28:39 user nova-compute[76815]:       <target dev="tap26aeb0f8-3e"/>
Nov 14 22:28:39 user nova-compute[76815]:     </interface>
Nov 14 22:28:39 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:28:39 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/console.log" append="off"/>
Nov 14 22:28:39 user nova-compute[76815]:     </serial>
Nov 14 22:28:39 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:28:39 user nova-compute[76815]:     <video>
Nov 14 22:28:39 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:28:39 user nova-compute[76815]:     </video>
Nov 14 22:28:39 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:28:39 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:28:39 user nova-compute[76815]:     </rng>
Nov 14 22:28:39 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:28:39 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:28:39 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:28:39 user nova-compute[76815]:     </memballoon>
Nov 14 22:28:39 user nova-compute[76815]:   </devices>
Nov 14 22:28:39 user nova-compute[76815]: </domain>
Nov 14 22:28:39 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:24:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-534347897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-534347897',id=36,image_ref='bcd94bef-7c5b-4b99-91e6-8678ed31aa6e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-621748568',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-tkwhh7x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member',shelved_at='2023-11-14T22:26:44.052993',shelved_host='user',shelved_image_id='bcd94bef-7c5b-4b99-91e6-8678ed31aa6e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=6c5a15b3-6d75-459b-a379-b756124a9c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG os_vif [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '977d5627-0ea6-509d-bd9e-45306d263770', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26aeb0f8-3e, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26aeb0f8-3e, col_values=(('qos', UUID('2f37df54-ebcb-4efb-8baa-45df7fcc471f')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26aeb0f8-3e, col_values=(('external_ids', {'iface-id': '26aeb0f8-3e23-4d18-946a-deec39e9788a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:87:4f', 'vm-uuid': '6c5a15b3-6d75-459b-a379-b756124a9c29'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:39 user nova-compute[76815]: INFO os_vif [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e')
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] No VIF found with MAC fa:16:3e:59:87:4f, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Successfully updated port: dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-95bbf429-7c18-49a9-86f0-9d6f26d7c28d req-563d6000-5f76-4136-9ced-bac440d7c08e service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received event network-changed-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-95bbf429-7c18-49a9-86f0-9d6f26d7c28d req-563d6000-5f76-4136-9ced-bac440d7c08e service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Refreshing instance network info cache due to event network-changed-dc142a4c-50db-4289-b438-effe10f42347. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-95bbf429-7c18-49a9-86f0-9d6f26d7c28d req-563d6000-5f76-4136-9ced-bac440d7c08e service nova] Acquiring lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-95bbf429-7c18-49a9-86f0-9d6f26d7c28d req-563d6000-5f76-4136-9ced-bac440d7c08e service nova] Acquired lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-95bbf429-7c18-49a9-86f0-9d6f26d7c28d req-563d6000-5f76-4136-9ced-bac440d7c08e service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Refreshing network info cache for port dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:28:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-95bbf429-7c18-49a9-86f0-9d6f26d7c28d req-563d6000-5f76-4136-9ced-bac440d7c08e service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.network.neutron [req-95bbf429-7c18-49a9-86f0-9d6f26d7c28d req-563d6000-5f76-4136-9ced-bac440d7c08e service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-95bbf429-7c18-49a9-86f0-9d6f26d7c28d req-563d6000-5f76-4136-9ced-bac440d7c08e service nova] Releasing lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquired lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.network.neutron [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Updating instance_info_cache with network_info: [{"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Releasing lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Instance network_info: |[{"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Start _get_guest_xml network_info=[{"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:28:40 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:28:40 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2028164980',display_name='tempest-TestServerVolumeAttachmentScenario-server-2028164980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2028164980',id=39,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnHA9rcrkESm32uBdG19iviRb0dPSZM28YoWLdwUyr/L94yMVpS7OctREPOOlpk4+7MtY5RPZy107XWaX1cp3lM7qX3La5pLVAQgMm7f7S9G8fhDJTOV+MvRxqbl9V93Q==',key_name='tempest-keypair-1375725796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf640863b51d408cb9c9a0e94e7b77bb',ramdisk_id='',reservation_id='r-kbqfspn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1804795114',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1804795114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:28:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f8e1c6f785d4f93ab73089de17904f4',uuid=91c8b85c-76f1-43ca-876f-575dafa1bc35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Converting VIF {"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:97:c8,bridge_name='br-int',has_traffic_filtering=True,id=dc142a4c-50db-4289-b438-effe10f42347,network=Network(508950bd-5aa8-4d80-83cb-1559deb1f65b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc142a4c-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lazy-loading 'pci_devices' on Instance uuid 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:28:40 user nova-compute[76815]:   <uuid>91c8b85c-76f1-43ca-876f-575dafa1bc35</uuid>
Nov 14 22:28:40 user nova-compute[76815]:   <name>instance-00000027</name>
Nov 14 22:28:40 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:28:40 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:28:40 user nova-compute[76815]:   <metadata>
Nov 14 22:28:40 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:28:40 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:28:40 user nova-compute[76815]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2028164980</nova:name>
Nov 14 22:28:40 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:28:40</nova:creationTime>
Nov 14 22:28:40 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:28:40 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:28:40 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:28:40 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:28:40 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:28:40 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:28:40 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:28:40 user nova-compute[76815]:       <nova:owner>
Nov 14 22:28:40 user nova-compute[76815]:         <nova:user uuid="3f8e1c6f785d4f93ab73089de17904f4">tempest-TestServerVolumeAttachmentScenario-1804795114-project-member</nova:user>
Nov 14 22:28:40 user nova-compute[76815]:         <nova:project uuid="bf640863b51d408cb9c9a0e94e7b77bb">tempest-TestServerVolumeAttachmentScenario-1804795114</nova:project>
Nov 14 22:28:40 user nova-compute[76815]:       </nova:owner>
Nov 14 22:28:40 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:28:40 user nova-compute[76815]:       <nova:ports>
Nov 14 22:28:40 user nova-compute[76815]:         <nova:port uuid="dc142a4c-50db-4289-b438-effe10f42347">
Nov 14 22:28:40 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 22:28:40 user nova-compute[76815]:         </nova:port>
Nov 14 22:28:40 user nova-compute[76815]:       </nova:ports>
Nov 14 22:28:40 user nova-compute[76815]:     </nova:instance>
Nov 14 22:28:40 user nova-compute[76815]:   </metadata>
Nov 14 22:28:40 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:28:40 user nova-compute[76815]:     <system>
Nov 14 22:28:40 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:28:40 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:28:40 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:28:40 user nova-compute[76815]:       <entry name="serial">91c8b85c-76f1-43ca-876f-575dafa1bc35</entry>
Nov 14 22:28:40 user nova-compute[76815]:       <entry name="uuid">91c8b85c-76f1-43ca-876f-575dafa1bc35</entry>
Nov 14 22:28:40 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:28:40 user nova-compute[76815]:     </system>
Nov 14 22:28:40 user nova-compute[76815]:   </sysinfo>
Nov 14 22:28:40 user nova-compute[76815]:   <os>
Nov 14 22:28:40 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:28:40 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:28:40 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:28:40 user nova-compute[76815]:   </os>
Nov 14 22:28:40 user nova-compute[76815]:   <features>
Nov 14 22:28:40 user nova-compute[76815]:     <acpi/>
Nov 14 22:28:40 user nova-compute[76815]:     <apic/>
Nov 14 22:28:40 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:28:40 user nova-compute[76815]:   </features>
Nov 14 22:28:40 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:28:40 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:28:40 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:28:40 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:28:40 user nova-compute[76815]:   </clock>
Nov 14 22:28:40 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:28:40 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:28:40 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:28:40 user nova-compute[76815]:   </cpu>
Nov 14 22:28:40 user nova-compute[76815]:   <devices>
Nov 14 22:28:40 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:28:40 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:28:40 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk"/>
Nov 14 22:28:40 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:28:40 user nova-compute[76815]:     </disk>
Nov 14 22:28:40 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:28:40 user nova-compute[76815]:       <mac address="fa:16:3e:f3:97:c8"/>
Nov 14 22:28:40 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:28:40 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:28:40 user nova-compute[76815]:       <target dev="tapdc142a4c-50"/>
Nov 14 22:28:40 user nova-compute[76815]:     </interface>
Nov 14 22:28:40 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:28:40 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/console.log" append="off"/>
Nov 14 22:28:40 user nova-compute[76815]:     </serial>
Nov 14 22:28:40 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:28:40 user nova-compute[76815]:     <video>
Nov 14 22:28:40 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:28:40 user nova-compute[76815]:     </video>
Nov 14 22:28:40 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:28:40 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:28:40 user nova-compute[76815]:     </rng>
Nov 14 22:28:40 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:28:40 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:28:40 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:28:40 user nova-compute[76815]:     </memballoon>
Nov 14 22:28:40 user nova-compute[76815]:   </devices>
Nov 14 22:28:40 user nova-compute[76815]: </domain>
Nov 14 22:28:40 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2028164980',display_name='tempest-TestServerVolumeAttachmentScenario-server-2028164980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2028164980',id=39,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnHA9rcrkESm32uBdG19iviRb0dPSZM28YoWLdwUyr/L94yMVpS7OctREPOOlpk4+7MtY5RPZy107XWaX1cp3lM7qX3La5pLVAQgMm7f7S9G8fhDJTOV+MvRxqbl9V93Q==',key_name='tempest-keypair-1375725796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf640863b51d408cb9c9a0e94e7b77bb',ramdisk_id='',reservation_id='r-kbqfspn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1804795114',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1804795114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:28:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f8e1c6f785d4f93ab73089de17904f4',uuid=91c8b85c-76f1-43ca-876f-575dafa1bc35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Converting VIF {"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:97:c8,bridge_name='br-int',has_traffic_filtering=True,id=dc142a4c-50db-4289-b438-effe10f42347,network=Network(508950bd-5aa8-4d80-83cb-1559deb1f65b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc142a4c-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG os_vif [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:97:c8,bridge_name='br-int',has_traffic_filtering=True,id=dc142a4c-50db-4289-b438-effe10f42347,network=Network(508950bd-5aa8-4d80-83cb-1559deb1f65b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc142a4c-50') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd29b1aeb-44e2-5cf1-8a3e-9305d18a58df', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc142a4c-50, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc142a4c-50, col_values=(('qos', UUID('15a8c861-16c6-4559-a575-c34fff4795d5')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc142a4c-50, col_values=(('external_ids', {'iface-id': 'dc142a4c-50db-4289-b438-effe10f42347', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:97:c8', 'vm-uuid': '91c8b85c-76f1-43ca-876f-575dafa1bc35'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:40 user nova-compute[76815]: INFO os_vif [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:97:c8,bridge_name='br-int',has_traffic_filtering=True,id=dc142a4c-50db-4289-b438-effe10f42347,network=Network(508950bd-5aa8-4d80-83cb-1559deb1f65b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc142a4c-50')
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] No VIF found with MAC fa:16:3e:f3:97:c8, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:28:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] No waiting events found dispatching network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:28:41 user nova-compute[76815]: WARNING nova.compute.manager [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received unexpected event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 22:28:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] No waiting events found dispatching network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:28:41 user nova-compute[76815]: WARNING nova.compute.manager [req-cc980305-4ab6-4472-a8c0-41f403e39f51 req-45b96457-b12c-4b5f-8e23-e691ca3ece1b service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received unexpected event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 22:28:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-5515fa09-c92d-4a1b-a380-545f83a9869e req-b7586c5c-7035-4b12-a93e-53c581c4da64 service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received event network-vif-plugged-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5515fa09-c92d-4a1b-a380-545f83a9869e req-b7586c5c-7035-4b12-a93e-53c581c4da64 service nova] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5515fa09-c92d-4a1b-a380-545f83a9869e req-b7586c5c-7035-4b12-a93e-53c581c4da64 service nova] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5515fa09-c92d-4a1b-a380-545f83a9869e req-b7586c5c-7035-4b12-a93e-53c581c4da64 service nova] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-5515fa09-c92d-4a1b-a380-545f83a9869e req-b7586c5c-7035-4b12-a93e-53c581c4da64 service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] No waiting events found dispatching network-vif-plugged-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:28:42 user nova-compute[76815]: WARNING nova.compute.manager [req-5515fa09-c92d-4a1b-a380-545f83a9869e req-b7586c5c-7035-4b12-a93e-53c581c4da64 service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received unexpected event network-vif-plugged-dc142a4c-50db-4289-b438-effe10f42347 for instance with vm_state building and task_state spawning.
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:28:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance spawned successfully.
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-90448254-06e3-4a8f-994b-cf73816c30d3 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.850s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Instance spawned successfully.
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-dd82d2b1-5a4a-4dae-b06d-800709ea1af5 req-691d0250-9a47-4be7-ad2c-5c0ddba504bb service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received event network-vif-plugged-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-dd82d2b1-5a4a-4dae-b06d-800709ea1af5 req-691d0250-9a47-4be7-ad2c-5c0ddba504bb service nova] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-dd82d2b1-5a4a-4dae-b06d-800709ea1af5 req-691d0250-9a47-4be7-ad2c-5c0ddba504bb service nova] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-dd82d2b1-5a4a-4dae-b06d-800709ea1af5 req-691d0250-9a47-4be7-ad2c-5c0ddba504bb service nova] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-dd82d2b1-5a4a-4dae-b06d-800709ea1af5 req-691d0250-9a47-4be7-ad2c-5c0ddba504bb service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] No waiting events found dispatching network-vif-plugged-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:28:44 user nova-compute[76815]: WARNING nova.compute.manager [req-dd82d2b1-5a4a-4dae-b06d-800709ea1af5 req-691d0250-9a47-4be7-ad2c-5c0ddba504bb service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received unexpected event network-vif-plugged-dc142a4c-50db-4289-b438-effe10f42347 for instance with vm_state building and task_state spawning.
Nov 14 22:28:44 user nova-compute[76815]: INFO nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 14 22:28:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:44 user nova-compute[76815]: INFO nova.compute.manager [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Took 7.03 seconds to build instance.
Nov 14 22:28:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e5a530c0-bc10-44e0-b365-e40f8d947335 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.129s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:45 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:28:45 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8166MB free_disk=24.769420623779297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 065c90e1-2099-4446-a998-de681bedf500 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 6bf4d919-7b71-4a01-8f73-f23f5ba76526 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3d82c8bf-899a-4e18-9738-8b6d067867bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 5625e9a8-df68-4abb-a423-59143395837c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 6c5a15b3-6d75-459b-a379-b756124a9c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:28:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:28:46 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:28:46 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:28:46 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:28:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:47 user nova-compute[76815]: INFO nova.compute.manager [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Terminating instance
Nov 14 22:28:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-8bc070dc-7b2d-4db5-86d8-83668e99c133 req-c5832486-5497-467f-bd9b-6ab25016aed9 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-unplugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8bc070dc-7b2d-4db5-86d8-83668e99c133 req-c5832486-5497-467f-bd9b-6ab25016aed9 service nova] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8bc070dc-7b2d-4db5-86d8-83668e99c133 req-c5832486-5497-467f-bd9b-6ab25016aed9 service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-8bc070dc-7b2d-4db5-86d8-83668e99c133 req-c5832486-5497-467f-bd9b-6ab25016aed9 service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-8bc070dc-7b2d-4db5-86d8-83668e99c133 req-c5832486-5497-467f-bd9b-6ab25016aed9 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] No waiting events found dispatching network-vif-unplugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-8bc070dc-7b2d-4db5-86d8-83668e99c133 req-c5832486-5497-467f-bd9b-6ab25016aed9 service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-unplugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:28:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Instance destroyed successfully.
Nov 14 22:28:47 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'resources' on Instance uuid 3d82c8bf-899a-4e18-9738-8b6d067867bf {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1598603901',display_name='tempest-ServerActionsTestOtherA-server-1598603901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1598603901',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVfME04PD9rglznppi8Ho3+jsumiOYFPtvR+yy+S2ej5C5M3kJOl8pyG4taHWLiqRqGcIU6SfKKWEu+JVsdH1FsdhxYcOosylxiuo+4fsZkdlqozg87LpEdVgLP6QXNw==',key_name='tempest-keypair-1998197341',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-ojj0ei0n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=3d82c8bf-899a-4e18-9738-8b6d067867bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "address": "fa:16:3e:6c:92:d9", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25c739be-c2", "ovs_interfaceid": "25c739be-c20c-4d5a-885e-ef0ad796a1fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG os_vif [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25c739be-c2, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c253c3f1-cf0c-4795-ba1d-a563ebd9e2bf) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:47 user nova-compute[76815]: INFO os_vif [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:92:d9,bridge_name='br-int',has_traffic_filtering=True,id=25c739be-c20c-4d5a-885e-ef0ad796a1fe,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25c739be-c2')
Nov 14 22:28:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRQLWaPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:28:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:28:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[436fd3c5-a494-44fd-843f-ceca121de4d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:28:47 user nova-compute[76815]: No targets found.
Nov 14 22:28:47 user nova-compute[76815]: iSNS:
Nov 14 22:28:47 user nova-compute[76815]: No targets found.
Nov 14 22:28:47 user nova-compute[76815]: STATIC:
Nov 14 22:28:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a
Nov 14 22:28:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:28:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:28:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:28:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:28:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:28:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a
Nov 14 22:28:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:28:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:28:47 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c
Nov 14 22:28:47 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:28:47 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:28:47 user nova-compute[76815]: FIRMWARE:
Nov 14 22:28:47 user nova-compute[76815]: No targets found.
Nov 14 22:28:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:28:47 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:28:47 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ddd9ee-1592-4fc7-850c-93abb36819da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[21922659-eb2c-40df-b676-b44e47d2af25]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:28:47 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:28:47 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:28:47 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:28:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:28:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:28:47 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:28:47 user nova-compute[76815]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c (non-flash)
Nov 14 22:28:47 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:28:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4587250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59450ba-6422-4c06-aa6e-7c8c3f5762df]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[66956fd7-86c0-40ff-87b1-5cc1eb691c90]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[52763a21-4f7f-4e84-869f-3410c76e73e1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c79f59-496d-458c-9b13-d1eb142ad726]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_94c48c87', '/dev/disk/by-id/scsi-1SCST_BIO94c48c87-600de1b1c905ace5', '/dev/disk/by-id/scsi-23630306465316231') {{(pid=86648) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6acf55-9c13-428b-ad9f-21d3720fce14]: (4, None) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[73270608-07ea-4343-a19a-b1c550f3d532]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe190277-16c9-4a79-97b5-ab378cd5a257]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260]
Nov 14 22:28:48 user nova-compute[76815]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c, portal: 172.16.0.220,3260] successful.
Nov 14 22:28:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee8f1159-f512-44d0-aa1e-ef39e3880c8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[241c6b8b-6fa8-4020-9919-d2e893293a61]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] <== disconnect_volume: return (369ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:28:48 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Deleting instance files /opt/stack/data/nova/instances/3d82c8bf-899a-4e18-9738-8b6d067867bf_del
Nov 14 22:28:48 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Deletion of /opt/stack/data/nova/instances/3d82c8bf-899a-4e18-9738-8b6d067867bf_del complete
Nov 14 22:28:48 user nova-compute[76815]: INFO nova.compute.manager [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 14 22:28:48 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:28:48 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Skipping network cache update for instance because it is being deleted. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:28:49 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Took 1.09 seconds to deallocate network for instance.
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-47a8a254-1f86-4701-ae7f-77b4282dc7cb req-9bbbbab6-babf-402d-82d9-54fd0e3a297c service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-deleted-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updating instance_info_cache with network_info: [{"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-955c274c-3777-4180-9220-644cc002d4a1 req-9ff04311-6ba9-4813-a800-215062e03bad service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-955c274c-3777-4180-9220-644cc002d4a1 req-9ff04311-6ba9-4813-a800-215062e03bad service nova] Acquiring lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-955c274c-3777-4180-9220-644cc002d4a1 req-9ff04311-6ba9-4813-a800-215062e03bad service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-955c274c-3777-4180-9220-644cc002d4a1 req-9ff04311-6ba9-4813-a800-215062e03bad service nova] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-955c274c-3777-4180-9220-644cc002d4a1 req-9ff04311-6ba9-4813-a800-215062e03bad service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] No waiting events found dispatching network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:28:49 user nova-compute[76815]: WARNING nova.compute.manager [req-955c274c-3777-4180-9220-644cc002d4a1 req-9ff04311-6ba9-4813-a800-215062e03bad service nova] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Received unexpected event network-vif-plugged-25c739be-c20c-4d5a-885e-ef0ad796a1fe for instance with vm_state active and task_state deleting.
Nov 14 22:28:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-6bf4d919-7b71-4a01-8f73-f23f5ba76526" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:28:50 user nova-compute[76815]: INFO nova.compute.manager [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Took 0.78 seconds to detach 1 volumes for instance.
Nov 14 22:28:50 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 3d82c8bf-899a-4e18-9738-8b6d067867bf] Deleting volume: ee8f1159-f512-44d0-aa1e-ef39e3880c8c {{(pid=76815) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 22:28:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:28:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:28:50 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:28:50 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:28:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:50 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Deleted allocations for instance 3d82c8bf-899a-4e18-9738-8b6d067867bf
Nov 14 22:28:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2969b641-d682-47ee-a9c5-efec8e797a37 tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "3d82c8bf-899a-4e18-9738-8b6d067867bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.771s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:28:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:28:54 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:28:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:29:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:29:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-d0706e45-aa56-4383-84b4-de2da4d8a2a3 req-0c602771-2e52-46d9-892f-d6375e7aa606 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received event network-changed-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-d0706e45-aa56-4383-84b4-de2da4d8a2a3 req-0c602771-2e52-46d9-892f-d6375e7aa606 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Refreshing instance network info cache due to event network-changed-1b25b7b1-c714-4772-91f1-4936cd9180af. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d0706e45-aa56-4383-84b4-de2da4d8a2a3 req-0c602771-2e52-46d9-892f-d6375e7aa606 service nova] Acquiring lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d0706e45-aa56-4383-84b4-de2da4d8a2a3 req-0c602771-2e52-46d9-892f-d6375e7aa606 service nova] Acquired lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG nova.network.neutron [req-d0706e45-aa56-4383-84b4-de2da4d8a2a3 req-0c602771-2e52-46d9-892f-d6375e7aa606 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Refreshing network info cache for port 1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "5625e9a8-df68-4abb-a423-59143395837c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "5625e9a8-df68-4abb-a423-59143395837c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "5625e9a8-df68-4abb-a423-59143395837c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:11 user nova-compute[76815]: INFO nova.compute.manager [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Terminating instance
Nov 14 22:29:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG nova.network.neutron [req-d0706e45-aa56-4383-84b4-de2da4d8a2a3 req-0c602771-2e52-46d9-892f-d6375e7aa606 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Updated VIF entry in instance network info cache for port 1b25b7b1-c714-4772-91f1-4936cd9180af. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG nova.network.neutron [req-d0706e45-aa56-4383-84b4-de2da4d8a2a3 req-0c602771-2e52-46d9-892f-d6375e7aa606 service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Updating instance_info_cache with network_info: [{"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d0706e45-aa56-4383-84b4-de2da4d8a2a3 req-0c602771-2e52-46d9-892f-d6375e7aa606 service nova] Releasing lock "refresh_cache-5625e9a8-df68-4abb-a423-59143395837c" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:29:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Instance destroyed successfully.
Nov 14 22:29:12 user nova-compute[76815]: DEBUG nova.objects.instance [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lazy-loading 'resources' on Instance uuid 5625e9a8-df68-4abb-a423-59143395837c {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:24:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-412997152',display_name='tempest-TestVolumeBootPattern-server-412997152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-412997152',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLVEyUh19O0alKw62tv3KmxoqsN7lyGaF0+P2xIoHxT+cKRRBx4MW7gidGmxry5UdKm4qrUC1sXQJe9NOXzjEcpENxKgmVXT2xLtMcWY8QrB8wG3DfxFfdkpczVqlfoPA==',key_name='tempest-TestVolumeBootPattern-1688630530',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:24:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673708a9f12541f6929c86eb60ca83c8',ramdisk_id='',reservation_id='r-6a5ag83m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1821264948',owner_user_name='tempest-TestVolumeBootPattern-1821264948-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:24:40Z,user_data=None,user_id='0fd5c7c940b0429994db55b93cb421ed',uuid=5625e9a8-df68-4abb-a423-59143395837c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converting VIF {"id": "1b25b7b1-c714-4772-91f1-4936cd9180af", "address": "fa:16:3e:4d:84:9c", "network": {"id": "554370fa-0fcc-4fc1-9c49-7756a28885da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-921275431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673708a9f12541f6929c86eb60ca83c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b25b7b1-c7", "ovs_interfaceid": "1b25b7b1-c714-4772-91f1-4936cd9180af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:84:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b25b7b1-c714-4772-91f1-4936cd9180af,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b25b7b1-c7') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_vif [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:84:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b25b7b1-c714-4772-91f1-4936cd9180af,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b25b7b1-c7') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b25b7b1-c7, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ea5fc9c-f0bc-4e88-9583-16a9bcecbb39) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:12 user nova-compute[76815]: INFO os_vif [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:84:9c,bridge_name='br-int',has_traffic_filtering=True,id=1b25b7b1-c714-4772-91f1-4936cd9180af,network=Network(554370fa-0fcc-4fc1-9c49-7756a28885da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b25b7b1-c7')
Nov 14 22:29:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTaBkxLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:29:12 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4069a9b-5079-4faa-bd41-d66c43078746]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:29:12 user nova-compute[76815]: No targets found.
Nov 14 22:29:12 user nova-compute[76815]: iSNS:
Nov 14 22:29:12 user nova-compute[76815]: No targets found.
Nov 14 22:29:12 user nova-compute[76815]: STATIC:
Nov 14 22:29:12 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a
Nov 14 22:29:12 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:29:12 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:29:12 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:29:12 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:29:12 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:29:12 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a
Nov 14 22:29:12 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:29:12 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:29:12 user nova-compute[76815]: FIRMWARE:
Nov 14 22:29:12 user nova-compute[76815]: No targets found.
Nov 14 22:29:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:29:12 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:29:12 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3928302-239c-4c2c-bd10-b359112845e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5542ba-b2c9-4739-ad58-ddc9f131d82f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:29:12 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:29:12 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:29:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:29:12 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:29:12 user nova-compute[76815]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a (non-flash)
Nov 14 22:29:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8785090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a'): ({'sde'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Removing single pathed devices sde {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1625b57f-d97c-468f-8acb-e9877c3abf16]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d898b6b-f0a5-43c0-9052-18d528f293f3]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Flushing IO for device /dev/sde {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[175f40f6-6045-43b7-b9fe-685d259ce36e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[16438f23-76b3-4235-bcac-0e8f7d6597d4]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] SCSI volumes sde have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3218f777-a2e0-419b-8693-4deb3256b5fb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:29:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99afe38b-f8c0-4aa2-8b2f-bec318e61d49]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260]
Nov 14 22:29:13 user nova-compute[76815]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a, portal: 172.16.0.220,3260] successful.
Nov 14 22:29:13 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d984fe4-59de-44c9-a2f3-29b71f1d854a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1984d-17b8-47aa-9426-ec97d48e0699]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] <== disconnect_volume: return (309ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:29:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Deleting instance files /opt/stack/data/nova/instances/5625e9a8-df68-4abb-a423-59143395837c_del
Nov 14 22:29:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Deletion of /opt/stack/data/nova/instances/5625e9a8-df68-4abb-a423-59143395837c_del complete
Nov 14 22:29:13 user nova-compute[76815]: INFO nova.compute.manager [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 5625e9a8-df68-4abb-a423-59143395837c] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:29:13 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Took 0.41 seconds to deallocate network for instance.
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received event network-vif-unplugged-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] Acquiring lock "5625e9a8-df68-4abb-a423-59143395837c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] No waiting events found dispatching network-vif-unplugged-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received event network-vif-unplugged-1b25b7b1-c714-4772-91f1-4936cd9180af for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received event network-vif-plugged-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] Acquiring lock "5625e9a8-df68-4abb-a423-59143395837c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] Lock "5625e9a8-df68-4abb-a423-59143395837c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] No waiting events found dispatching network-vif-plugged-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:29:13 user nova-compute[76815]: WARNING nova.compute.manager [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received unexpected event network-vif-plugged-1b25b7b1-c714-4772-91f1-4936cd9180af for instance with vm_state active and task_state deleting.
Nov 14 22:29:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-3ef4168e-8280-4b98-92c0-12e636ab1c2a req-b762f9a9-4176-4006-8cea-a660e638a8df service nova] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Received event network-vif-deleted-1b25b7b1-c714-4772-91f1-4936cd9180af {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:14 user nova-compute[76815]: INFO nova.compute.manager [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] [instance: 5625e9a8-df68-4abb-a423-59143395837c] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 22:29:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:14 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:29:14 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:29:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:14 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Deleted allocations for instance 5625e9a8-df68-4abb-a423-59143395837c
Nov 14 22:29:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-6b7ffeb3-45ef-4521-9396-b4065ec4a45a tempest-TestVolumeBootPattern-1821264948 tempest-TestVolumeBootPattern-1821264948-project-member] Lock "5625e9a8-df68-4abb-a423-59143395837c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.731s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:29 user nova-compute[76815]: INFO nova.compute.manager [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Terminating instance
Nov 14 22:29:29 user nova-compute[76815]: DEBUG nova.compute.manager [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-0f2de217-bf93-4cfe-b25c-13b9fe3abf40 req-88ce4c24-9e90-464d-ae26-61c1c96879ce service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-unplugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0f2de217-bf93-4cfe-b25c-13b9fe3abf40 req-88ce4c24-9e90-464d-ae26-61c1c96879ce service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0f2de217-bf93-4cfe-b25c-13b9fe3abf40 req-88ce4c24-9e90-464d-ae26-61c1c96879ce service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0f2de217-bf93-4cfe-b25c-13b9fe3abf40 req-88ce4c24-9e90-464d-ae26-61c1c96879ce service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-0f2de217-bf93-4cfe-b25c-13b9fe3abf40 req-88ce4c24-9e90-464d-ae26-61c1c96879ce service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-unplugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:29:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-0f2de217-bf93-4cfe-b25c-13b9fe3abf40 req-88ce4c24-9e90-464d-ae26-61c1c96879ce service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-unplugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:30 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Instance destroyed successfully.
Nov 14 22:29:30 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'resources' on Instance uuid 6bf4d919-7b71-4a01-8f73-f23f5ba76526 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1524441459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1524441459',id=34,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:25:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-sahpvd6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:27:43Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=6bf4d919-7b71-4a01-8f73-f23f5ba76526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "address": "fa:16:3e:82:15:5a", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2cbfde8-95", "ovs_interfaceid": "f2cbfde8-95a0-4602-9b7a-bb86e213a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=f2cbfde8-95a0-4602-9b7a-bb86e213a377,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cbfde8-95') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_vif [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=f2cbfde8-95a0-4602-9b7a-bb86e213a377,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cbfde8-95') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2cbfde8-95, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5fda472e-01c1-4b26-840a-c7d245e5b668) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:30 user nova-compute[76815]: INFO os_vif [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:15:5a,bridge_name='br-int',has_traffic_filtering=True,id=f2cbfde8-95a0-4602-9b7a-bb86e213a377,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2cbfde8-95')
Nov 14 22:29:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUQZdafv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:29:30 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[174015cf-f8dd-4d3f-9d35-5a0e4b58cc94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:29:30 user nova-compute[76815]: No targets found.
Nov 14 22:29:30 user nova-compute[76815]: iSNS:
Nov 14 22:29:30 user nova-compute[76815]: No targets found.
Nov 14 22:29:30 user nova-compute[76815]: STATIC:
Nov 14 22:29:30 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:29:30 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:29:30 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:29:30 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a
Nov 14 22:29:30 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:29:30 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:29:30 user nova-compute[76815]: FIRMWARE:
Nov 14 22:29:30 user nova-compute[76815]: No targets found.
Nov 14 22:29:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:29:30 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:29:30 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[607e59d3-63b2-481b-b530-86a3ba151aa2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[907cf7ba-4554-42fd-8e19-b01a4494127d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:29:30 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:29:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:29:30 user nova-compute[76815]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a (non-flash)
Nov 14 22:29:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c862b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0b6813-11d2-4117-b2a2-9179b7dac40f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d24502-355d-42e7-8b59-2a986e05e655]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b721a6-1177-4838-90d6-75b29aa60f4a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d684183-86fc-4d88-9681-f7d8d27c4a2e]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1765458c-5206e6c106a0646f', '/dev/disk/by-id/scsi-23532303665366331', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1765458c') {{(pid=86648) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f1853f-de0a-43c5-8491-f52b3954744a]: (4, None) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d2e4e-841b-4dae-b6b7-17fc58517cf0]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb64abc-5f4f-4cec-8305-f19ae656c994]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a, portal: 172.16.0.220,3260]
Nov 14 22:29:30 user nova-compute[76815]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a, portal: 172.16.0.220,3260] successful.
Nov 14 22:29:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b322f8f6-b262-4a1d-a26a-e74aa9ee748a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[38590e67-7cec-4430-95dc-e32216558213]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] <== disconnect_volume: return (298ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:29:30 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Deleting instance files /opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526_del
Nov 14 22:29:30 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Deletion of /opt/stack/data/nova/instances/6bf4d919-7b71-4a01-8f73-f23f5ba76526_del complete
Nov 14 22:29:30 user nova-compute[76815]: INFO nova.compute.manager [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 22:29:30 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:29:30 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:29:31 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:29:31 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Took 0.43 seconds to deallocate network for instance.
Nov 14 22:29:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-811d127c-00d7-4c2c-b64a-89b6d33a2cf9 req-4d148976-a639-486b-bb29-d8ebd5d7d79b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-deleted-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:31 user nova-compute[76815]: INFO nova.compute.manager [req-811d127c-00d7-4c2c-b64a-89b6d33a2cf9 req-4d148976-a639-486b-bb29-d8ebd5d7d79b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Neutron deleted interface f2cbfde8-95a0-4602-9b7a-bb86e213a377; detaching it from the instance and deleting it from the info cache
Nov 14 22:29:31 user nova-compute[76815]: DEBUG nova.network.neutron [req-811d127c-00d7-4c2c-b64a-89b6d33a2cf9 req-4d148976-a639-486b-bb29-d8ebd5d7d79b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:29:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-811d127c-00d7-4c2c-b64a-89b6d33a2cf9 req-4d148976-a639-486b-bb29-d8ebd5d7d79b service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Detach interface failed, port_id=f2cbfde8-95a0-4602-9b7a-bb86e213a377, reason: Instance 6bf4d919-7b71-4a01-8f73-f23f5ba76526 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:29:31 user nova-compute[76815]: INFO nova.compute.manager [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 22:29:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa55c6de-9079-49fb-bcaa-ad899e480af2 req-e43b009c-aa32-4dac-af01-7ded29b41534 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa55c6de-9079-49fb-bcaa-ad899e480af2 req-e43b009c-aa32-4dac-af01-7ded29b41534 service nova] Acquiring lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa55c6de-9079-49fb-bcaa-ad899e480af2 req-e43b009c-aa32-4dac-af01-7ded29b41534 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-aa55c6de-9079-49fb-bcaa-ad899e480af2 req-e43b009c-aa32-4dac-af01-7ded29b41534 service nova] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-aa55c6de-9079-49fb-bcaa-ad899e480af2 req-e43b009c-aa32-4dac-af01-7ded29b41534 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] No waiting events found dispatching network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:29:31 user nova-compute[76815]: WARNING nova.compute.manager [req-aa55c6de-9079-49fb-bcaa-ad899e480af2 req-e43b009c-aa32-4dac-af01-7ded29b41534 service nova] [instance: 6bf4d919-7b71-4a01-8f73-f23f5ba76526] Received unexpected event network-vif-plugged-f2cbfde8-95a0-4602-9b7a-bb86e213a377 for instance with vm_state deleted and task_state None.
Nov 14 22:29:31 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:29:32 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:29:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:32 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Deleted allocations for instance 6bf4d919-7b71-4a01-8f73-f23f5ba76526
Nov 14 22:29:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3f68317e-fdee-4d74-b7c0-a53a521f6b58 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "6bf4d919-7b71-4a01-8f73-f23f5ba76526" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.669s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "065c90e1-2099-4446-a998-de681bedf500" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "065c90e1-2099-4446-a998-de681bedf500" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "065c90e1-2099-4446-a998-de681bedf500-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "065c90e1-2099-4446-a998-de681bedf500-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "065c90e1-2099-4446-a998-de681bedf500-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:39 user nova-compute[76815]: INFO nova.compute.manager [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Terminating instance
Nov 14 22:29:39 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:29:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-64dde857-e859-4d68-a61c-474b81d35453 req-480f00b7-b918-44d2-be1e-554fecc3a132 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received event network-vif-unplugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-64dde857-e859-4d68-a61c-474b81d35453 req-480f00b7-b918-44d2-be1e-554fecc3a132 service nova] Acquiring lock "065c90e1-2099-4446-a998-de681bedf500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-64dde857-e859-4d68-a61c-474b81d35453 req-480f00b7-b918-44d2-be1e-554fecc3a132 service nova] Lock "065c90e1-2099-4446-a998-de681bedf500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-64dde857-e859-4d68-a61c-474b81d35453 req-480f00b7-b918-44d2-be1e-554fecc3a132 service nova] Lock "065c90e1-2099-4446-a998-de681bedf500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-64dde857-e859-4d68-a61c-474b81d35453 req-480f00b7-b918-44d2-be1e-554fecc3a132 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] No waiting events found dispatching network-vif-unplugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-64dde857-e859-4d68-a61c-474b81d35453 req-480f00b7-b918-44d2-be1e-554fecc3a132 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received event network-vif-unplugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 065c90e1-2099-4446-a998-de681bedf500] Instance destroyed successfully.
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.objects.instance [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lazy-loading 'resources' on Instance uuid 065c90e1-2099-4446-a998-de681bedf500 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1093783850',display_name='tempest-ServerActionsTestOtherA-server-1093783850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1093783850',id=15,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVfME04PD9rglznppi8Ho3+jsumiOYFPtvR+yy+S2ej5C5M3kJOl8pyG4taHWLiqRqGcIU6SfKKWEu+JVsdH1FsdhxYcOosylxiuo+4fsZkdlqozg87LpEdVgLP6QXNw==',key_name='tempest-keypair-1998197341',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:11:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b7e88b0ec54c5b9f15ae859e8c3984',ramdisk_id='',reservation_id='r-kbmqf7bp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2016206168',owner_user_name='tempest-ServerActionsTestOtherA-2016206168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85a900897f3a42bd89f966f4b7e253f6',uuid=065c90e1-2099-4446-a998-de681bedf500,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converting VIF {"id": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "address": "fa:16:3e:21:d0:fd", "network": {"id": "5b60d89e-b1f2-401c-964b-68fd80fb3669", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1188991552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b7e88b0ec54c5b9f15ae859e8c3984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc5e49f0-2f", "ovs_interfaceid": "dc5e49f0-2f7c-4750-86ab-270834c97d82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:d0:fd,bridge_name='br-int',has_traffic_filtering=True,id=dc5e49f0-2f7c-4750-86ab-270834c97d82,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5e49f0-2f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG os_vif [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d0:fd,bridge_name='br-int',has_traffic_filtering=True,id=dc5e49f0-2f7c-4750-86ab-270834c97d82,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5e49f0-2f') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc5e49f0-2f, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35ef02cc-48a0-4f24-aafb-f05c84f49029) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:40 user nova-compute[76815]: INFO os_vif [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:d0:fd,bridge_name='br-int',has_traffic_filtering=True,id=dc5e49f0-2f7c-4750-86ab-270834c97d82,network=Network(5b60d89e-b1f2-401c-964b-68fd80fb3669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc5e49f0-2f')
Nov 14 22:29:40 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Deleting instance files /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500_del
Nov 14 22:29:40 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Deletion of /opt/stack/data/nova/instances/065c90e1-2099-4446-a998-de681bedf500_del complete
Nov 14 22:29:40 user nova-compute[76815]: INFO nova.compute.manager [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] [instance: 065c90e1-2099-4446-a998-de681bedf500] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 14 22:29:40 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 065c90e1-2099-4446-a998-de681bedf500] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 065c90e1-2099-4446-a998-de681bedf500] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:29:40 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 065c90e1-2099-4446-a998-de681bedf500] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:29:40 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 065c90e1-2099-4446-a998-de681bedf500] Took 0.37 seconds to deallocate network for instance.
Nov 14 22:29:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:41 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:29:41 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:29:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:41 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Deleted allocations for instance 065c90e1-2099-4446-a998-de681bedf500
Nov 14 22:29:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d8586992-3623-4eaa-be25-988cfd5ac25b tempest-ServerActionsTestOtherA-2016206168 tempest-ServerActionsTestOtherA-2016206168-project-member] Lock "065c90e1-2099-4446-a998-de681bedf500" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.495s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-35babec8-535f-4023-82c3-fa6af3d4c935 req-1af470d3-abbb-4fbe-9ad3-0d3d2dd90696 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received event network-vif-plugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-35babec8-535f-4023-82c3-fa6af3d4c935 req-1af470d3-abbb-4fbe-9ad3-0d3d2dd90696 service nova] Acquiring lock "065c90e1-2099-4446-a998-de681bedf500-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-35babec8-535f-4023-82c3-fa6af3d4c935 req-1af470d3-abbb-4fbe-9ad3-0d3d2dd90696 service nova] Lock "065c90e1-2099-4446-a998-de681bedf500-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-35babec8-535f-4023-82c3-fa6af3d4c935 req-1af470d3-abbb-4fbe-9ad3-0d3d2dd90696 service nova] Lock "065c90e1-2099-4446-a998-de681bedf500-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-35babec8-535f-4023-82c3-fa6af3d4c935 req-1af470d3-abbb-4fbe-9ad3-0d3d2dd90696 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] No waiting events found dispatching network-vif-plugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:29:42 user nova-compute[76815]: WARNING nova.compute.manager [req-35babec8-535f-4023-82c3-fa6af3d4c935 req-1af470d3-abbb-4fbe-9ad3-0d3d2dd90696 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received unexpected event network-vif-plugged-dc5e49f0-2f7c-4750-86ab-270834c97d82 for instance with vm_state deleted and task_state None.
Nov 14 22:29:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-35babec8-535f-4023-82c3-fa6af3d4c935 req-1af470d3-abbb-4fbe-9ad3-0d3d2dd90696 service nova] [instance: 065c90e1-2099-4446-a998-de681bedf500] Received event network-vif-deleted-dc5e49f0-2f7c-4750-86ab-270834c97d82 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:29:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:29:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:29:45 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:29:45 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8351MB free_disk=24.856597900390625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 6c5a15b3-6d75-459b-a379-b756124a9c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:29:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:29:48 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:48 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:29:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:29:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:29:50 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:50 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:29:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:29:56 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:29:56 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:30:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:20 user nova-compute[76815]: INFO nova.compute.manager [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Terminating instance
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-3e889408-df65-4465-ab68-eabe614fe3ff req-087d3c16-2e27-4194-b6ac-2c9205852b56 service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received event network-vif-unplugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3e889408-df65-4465-ab68-eabe614fe3ff req-087d3c16-2e27-4194-b6ac-2c9205852b56 service nova] Acquiring lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3e889408-df65-4465-ab68-eabe614fe3ff req-087d3c16-2e27-4194-b6ac-2c9205852b56 service nova] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3e889408-df65-4465-ab68-eabe614fe3ff req-087d3c16-2e27-4194-b6ac-2c9205852b56 service nova] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-3e889408-df65-4465-ab68-eabe614fe3ff req-087d3c16-2e27-4194-b6ac-2c9205852b56 service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] No waiting events found dispatching network-vif-unplugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-3e889408-df65-4465-ab68-eabe614fe3ff req-087d3c16-2e27-4194-b6ac-2c9205852b56 service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received event network-vif-unplugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Instance destroyed successfully.
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.objects.instance [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'resources' on Instance uuid f4f3b768-b95c-4dd3-807c-de5cdbc5ea84 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1750418106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1750418106',id=31,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-276xbjog',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:22:54Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=f4f3b768-b95c-4dd3-807c-de5cdbc5ea84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "address": "fa:16:3e:8b:8d:d3", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4c4ca9-50", "ovs_interfaceid": "7e4c4ca9-50d1-4328-90e4-4b3911e1407e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:8d:d3,bridge_name='br-int',has_traffic_filtering=True,id=7e4c4ca9-50d1-4328-90e4-4b3911e1407e,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c4ca9-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG os_vif [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:8d:d3,bridge_name='br-int',has_traffic_filtering=True,id=7e4c4ca9-50d1-4328-90e4-4b3911e1407e,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c4ca9-50') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e4c4ca9-50, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7be43da7-5343-468d-8666-37b090ca2f1b) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:30:20 user nova-compute[76815]: INFO os_vif [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:8d:d3,bridge_name='br-int',has_traffic_filtering=True,id=7e4c4ca9-50d1-4328-90e4-4b3911e1407e,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4c4ca9-50')
Nov 14 22:30:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Deleting instance files /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84_del
Nov 14 22:30:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Deletion of /opt/stack/data/nova/instances/f4f3b768-b95c-4dd3-807c-de5cdbc5ea84_del complete
Nov 14 22:30:20 user nova-compute[76815]: INFO nova.compute.manager [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 14 22:30:20 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:30:20 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:30:21 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:30:21 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Took 0.38 seconds to deallocate network for instance.
Nov 14 22:30:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:21 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:30:21 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:30:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:21 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Deleted allocations for instance f4f3b768-b95c-4dd3-807c-de5cdbc5ea84
Nov 14 22:30:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1459c8a5-d7c3-4844-9525-9587c3701c9f tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.416s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-af5aae72-e8ea-42e4-bc4a-847b43838205 req-8475625c-8dc8-4f41-a6ce-60a4574ded8c service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received event network-vif-plugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-af5aae72-e8ea-42e4-bc4a-847b43838205 req-8475625c-8dc8-4f41-a6ce-60a4574ded8c service nova] Acquiring lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-af5aae72-e8ea-42e4-bc4a-847b43838205 req-8475625c-8dc8-4f41-a6ce-60a4574ded8c service nova] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-af5aae72-e8ea-42e4-bc4a-847b43838205 req-8475625c-8dc8-4f41-a6ce-60a4574ded8c service nova] Lock "f4f3b768-b95c-4dd3-807c-de5cdbc5ea84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-af5aae72-e8ea-42e4-bc4a-847b43838205 req-8475625c-8dc8-4f41-a6ce-60a4574ded8c service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] No waiting events found dispatching network-vif-plugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:30:22 user nova-compute[76815]: WARNING nova.compute.manager [req-af5aae72-e8ea-42e4-bc4a-847b43838205 req-8475625c-8dc8-4f41-a6ce-60a4574ded8c service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received unexpected event network-vif-plugged-7e4c4ca9-50d1-4328-90e4-4b3911e1407e for instance with vm_state deleted and task_state None.
Nov 14 22:30:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-af5aae72-e8ea-42e4-bc4a-847b43838205 req-8475625c-8dc8-4f41-a6ce-60a4574ded8c service nova] [instance: f4f3b768-b95c-4dd3-807c-de5cdbc5ea84] Received event network-vif-deleted-7e4c4ca9-50d1-4328-90e4-4b3911e1407e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:22 user nova-compute[76815]: INFO nova.compute.manager [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Terminating instance
Nov 14 22:30:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-a8fe6244-8bdf-4798-b2c4-278b21ded5ab req-b43ac8bc-7718-4dee-9bfc-c9f9cef5847e service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-unplugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a8fe6244-8bdf-4798-b2c4-278b21ded5ab req-b43ac8bc-7718-4dee-9bfc-c9f9cef5847e service nova] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a8fe6244-8bdf-4798-b2c4-278b21ded5ab req-b43ac8bc-7718-4dee-9bfc-c9f9cef5847e service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a8fe6244-8bdf-4798-b2c4-278b21ded5ab req-b43ac8bc-7718-4dee-9bfc-c9f9cef5847e service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-a8fe6244-8bdf-4798-b2c4-278b21ded5ab req-b43ac8bc-7718-4dee-9bfc-c9f9cef5847e service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] No waiting events found dispatching network-vif-unplugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-a8fe6244-8bdf-4798-b2c4-278b21ded5ab req-b43ac8bc-7718-4dee-9bfc-c9f9cef5847e service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-unplugged-26aeb0f8-3e23-4d18-946a-deec39e9788a for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:30:23 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Instance destroyed successfully.
Nov 14 22:30:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lazy-loading 'resources' on Instance uuid 6c5a15b3-6d75-459b-a379-b756124a9c29 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T22:24:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-534347897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-534347897',id=36,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZILfldAReFZ5UtvJtfYXt/dkmY/wU8c/O723H+6gC1WF12YMQsz92HeN79HKXyOKV/c5QfCiehJOw5MxSa1EU1XguruLemXyjytD1YssyT5k8QEqVLL6jZBnY8qp3AnA==',key_name='tempest-keypair-621748568',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:28:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bad961b0e704e2483d2de3d382a23b6',ramdisk_id='',reservation_id='r-tkwhh7x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1125875673',owner_user_name='tempest-AttachVolumeShelveTestJSON-1125875673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:28:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50afb4444eea433ba80e4f4e84821101',uuid=6c5a15b3-6d75-459b-a379-b756124a9c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converting VIF {"id": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "address": "fa:16:3e:59:87:4f", "network": {"id": "e4a2a600-a48a-4ed9-b652-468f0125954d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1935065509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bad961b0e704e2483d2de3d382a23b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26aeb0f8-3e", "ovs_interfaceid": "26aeb0f8-3e23-4d18-946a-deec39e9788a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG os_vif [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26aeb0f8-3e, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f37df54-ebcb-4efb-8baa-45df7fcc471f) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:30:23 user nova-compute[76815]: INFO os_vif [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:87:4f,bridge_name='br-int',has_traffic_filtering=True,id=26aeb0f8-3e23-4d18-946a-deec39e9788a,network=Network(e4a2a600-a48a-4ed9-b652-468f0125954d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26aeb0f8-3e')
Nov 14 22:30:23 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Deleting instance files /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29_del
Nov 14 22:30:23 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Deletion of /opt/stack/data/nova/instances/6c5a15b3-6d75-459b-a379-b756124a9c29_del complete
Nov 14 22:30:23 user nova-compute[76815]: INFO nova.compute.manager [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 14 22:30:23 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:30:23 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:30:24 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:30:24 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Took 0.80 seconds to deallocate network for instance.
Nov 14 22:30:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:24 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:30:24 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:30:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:24 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Deleted allocations for instance 6c5a15b3-6d75-459b-a379-b756124a9c29
Nov 14 22:30:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-01f2b126-6cd2-45cf-b269-4839043d5afd req-959b7fa4-70b4-4466-adfc-9474f0a5a30f service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-deleted-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c70301b-0cf1-4158-af2d-ddd03da7c080 tempest-AttachVolumeShelveTestJSON-1125875673 tempest-AttachVolumeShelveTestJSON-1125875673-project-member] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-7b69b6ae-68ef-4326-b938-695eb1afcfe7 req-6b06bf96-148b-4173-bb0e-949fa8df8336 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7b69b6ae-68ef-4326-b938-695eb1afcfe7 req-6b06bf96-148b-4173-bb0e-949fa8df8336 service nova] Acquiring lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7b69b6ae-68ef-4326-b938-695eb1afcfe7 req-6b06bf96-148b-4173-bb0e-949fa8df8336 service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:25 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7b69b6ae-68ef-4326-b938-695eb1afcfe7 req-6b06bf96-148b-4173-bb0e-949fa8df8336 service nova] Lock "6c5a15b3-6d75-459b-a379-b756124a9c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:25 user nova-compute[76815]: DEBUG nova.compute.manager [req-7b69b6ae-68ef-4326-b938-695eb1afcfe7 req-6b06bf96-148b-4173-bb0e-949fa8df8336 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] No waiting events found dispatching network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:30:25 user nova-compute[76815]: WARNING nova.compute.manager [req-7b69b6ae-68ef-4326-b938-695eb1afcfe7 req-6b06bf96-148b-4173-bb0e-949fa8df8336 service nova] [instance: 6c5a15b3-6d75-459b-a379-b756124a9c29] Received unexpected event network-vif-plugged-26aeb0f8-3e23-4d18-946a-deec39e9788a for instance with vm_state deleted and task_state None.
Nov 14 22:30:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-5951d019-348e-4b2f-ba98-99783a67f717 req-4706694f-43a4-4db7-a396-5d2d8cd293aa service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received event network-changed-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-5951d019-348e-4b2f-ba98-99783a67f717 req-4706694f-43a4-4db7-a396-5d2d8cd293aa service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Refreshing instance network info cache due to event network-changed-dc142a4c-50db-4289-b438-effe10f42347. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:30:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5951d019-348e-4b2f-ba98-99783a67f717 req-4706694f-43a4-4db7-a396-5d2d8cd293aa service nova] Acquiring lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:30:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5951d019-348e-4b2f-ba98-99783a67f717 req-4706694f-43a4-4db7-a396-5d2d8cd293aa service nova] Acquired lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:30:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-5951d019-348e-4b2f-ba98-99783a67f717 req-4706694f-43a4-4db7-a396-5d2d8cd293aa service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Refreshing network info cache for port dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-5951d019-348e-4b2f-ba98-99783a67f717 req-4706694f-43a4-4db7-a396-5d2d8cd293aa service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Updated VIF entry in instance network info cache for port dc142a4c-50db-4289-b438-effe10f42347. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-5951d019-348e-4b2f-ba98-99783a67f717 req-4706694f-43a4-4db7-a396-5d2d8cd293aa service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Updating instance_info_cache with network_info: [{"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5951d019-348e-4b2f-ba98-99783a67f717 req-4706694f-43a4-4db7-a396-5d2d8cd293aa service nova] Releasing lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lazy-loading 'flavor' on Instance uuid 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:29 user nova-compute[76815]: INFO nova.compute.manager [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Attaching volume bc939797-3a7e-491c-9e5e-35f9ea81c64b to /dev/vdb
Nov 14 22:30:29 user nova-compute[76815]: DEBUG os_brick.utils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5340c120-fbe4-4c88-8fff-1a96c04cb090]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d46d30-3654-4e3a-90bd-d62a502377d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[65513e5f-6e59-4815-b053-edda6370bcff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccff51d9-b55d-4c1a-8c85-b3d88b571a66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:30:29 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:30:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1bb681-2110-4186-be05-efad5f228214]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG os_brick.utils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:30:29 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Updating existing volume attachment record: 2fe04d5b-8965-42ee-b2a3-5221f7436963 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:30:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HICLsRUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:30:34 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:30:34 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:30:34 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcc684b-27ac-48c3-a3aa-3cf6773d4367]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:30:34 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd2984-4c60-4402-8633-beb1013fa006]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b] added
Nov 14 22:30:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d74a101-7749-4af7-9cd3-e802360ed40f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24e32a8-b1ca-444e-a37a-b40f3151eb00]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HICLsRUS {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HICLsRUS" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eae6281-6dd5-454b-8c95-88474591b1da]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HICLsRUS'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd23ad33-69f4-4d2d-8b0b-b58254ade627]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2fb7e6-f723-4a00-8f52-37a5fe3bfda6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:30:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:30:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7b93b8-d20c-4c53-ba0b-bb40b19eca38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b, portal: 172.16.0.220,3260]
Nov 14 22:30:34 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b, portal: 172.16.0.220,3260] successful.
Nov 14 22:30:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d03766-044f-49ff-beab-24aa719668e2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7656eef1-1eb1-44d8-92b5-c5716591f7f5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:30:34 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:30:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:30:34 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:30:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694bf5e-e8c2-4ebb-947b-cae4fa5bfb8f]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:30:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HICLsRUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:30:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:30:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26139363733376537', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:30:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139363733376537', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:30:35 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lazy-loading 'flavor' on Instance uuid 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:30:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:30:35 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:30:35 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:30:35 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:30:35 user nova-compute[76815]:   <serial>bc939797-3a7e-491c-9e5e-35f9ea81c64b</serial>
Nov 14 22:30:35 user nova-compute[76815]: </disk>
Nov 14 22:30:35 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:30:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:30:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:30:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] No VIF found with MAC fa:16:3e:f3:97:c8, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:30:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4b7d8a38-a38c-4114-9e82-92bd0c743018 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.323s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:38 user nova-compute[76815]: DEBUG nova.objects.instance [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lazy-loading 'flavor' on Instance uuid 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:30:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:39 user nova-compute[76815]: INFO nova.compute.manager [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Attaching volume bbab3aea-c033-4ca0-bbd0-d44c7ff84218 to /dev/vdc
Nov 14 22:30:39 user nova-compute[76815]: DEBUG os_brick.utils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e64425-6bc0-4ef0-a772-fffddd0672e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[84834fa7-3330-4e47-9df3-cb90dc5990cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bef06b-5714-4281-a47e-e0c64480d596]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8877268c-f71c-4dae-a502-01cd56d36d84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:30:39 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:30:39 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77a66f-9a56-41ed-96cb-8bde19bd1478]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG os_brick.utils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:30:39 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Updating existing volume attachment record: 50462f78-35f2-41d8-beb5-0732fc5fdbb2 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:30:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:30:43 user nova-compute[76815]: INFO nova.compute.claims [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Claim successful on node user
Nov 14 22:30:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvyKfCzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:30:43 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:30:43 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:30:43 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb744311-0841-4ba3-81ce-47f051298079]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:30:43 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4ee7db-a04a-4b37-9410-847e45cf9b55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218] added
Nov 14 22:30:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be8adf9-75f7-403f-aed5-35e26062282a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ca019e-ca1f-4b7d-b48e-9b91da805646]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvyKfCzJ {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvyKfCzJ" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d273eee-daeb-4563-ab9c-73e097ca516f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hvyKfCzJ'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f32122-f2db-4a7a-87dd-d5d8b7b4a77a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.policy [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26aadea3a6964715be30b0fbb2c61c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd690e5ff8584e2f9e24597816d90b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca1405e-6ea7-4e96-b516-a7f5e66bcc6b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:30:43 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:30:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:30:43 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:30:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75e82ee-b002-45bb-855a-f86463207c1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218, portal: 172.16.0.220,3260]
Nov 14 22:30:43 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218, portal: 172.16.0.220,3260] successful.
Nov 14 22:30:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13aea38-71e6-4e83-85f6-f1668dc59b74]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:30:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Creating image(s)
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "/opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "/opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "/opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[89893d84-542a-4b85-af2d-df1777ae90a6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:30:43 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:30:43 user nova-compute[76815]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 (non-flash)
Nov 14 22:30:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:30:43 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:30:43 user nova-compute[76815]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 (non-flash)
Nov 14 22:30:43 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5becffa-4243-44fa-b1b5-ed0ffbc9bbc1]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvyKfCzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk 1073741824" returned: 0 in 0.047s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Successfully created port: 6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Cannot resize image /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Ensure instance console log exists: /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:30:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Successfully updated port: 6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.743s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] <== connect_volume: return (1744ms) {'type': 'block', 'scsi_wwn': '23966623538656162', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966623538656162', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-55991e4c-81c0-4c58-a224-b53e0f2c476d req-713e67a3-5fff-4b5c-a170-5519da346422 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received event network-changed-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-55991e4c-81c0-4c58-a224-b53e0f2c476d req-713e67a3-5fff-4b5c-a170-5519da346422 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Refreshing instance network info cache due to event network-changed-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55991e4c-81c0-4c58-a224-b53e0f2c476d req-713e67a3-5fff-4b5c-a170-5519da346422 service nova] Acquiring lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55991e4c-81c0-4c58-a224-b53e0f2c476d req-713e67a3-5fff-4b5c-a170-5519da346422 service nova] Acquired lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-55991e4c-81c0-4c58-a224-b53e0f2c476d req-713e67a3-5fff-4b5c-a170-5519da346422 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Refreshing network info cache for port 6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:30:45 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:30:45 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8738MB free_disk=25.00674057006836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.objects.instance [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lazy-loading 'flavor' on Instance uuid 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:30:45 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:30:45 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:30:45 user nova-compute[76815]:   <target dev="vdc" bus="virtio"/>
Nov 14 22:30:45 user nova-compute[76815]:   <serial>bbab3aea-c033-4ca0-bbd0-d44c7ff84218</serial>
Nov 14 22:30:45 user nova-compute[76815]: </disk>
Nov 14 22:30:45 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-55991e4c-81c0-4c58-a224-b53e0f2c476d req-713e67a3-5fff-4b5c-a170-5519da346422 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44223f88-c27a-4240-a6c8-754379a66a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-55991e4c-81c0-4c58-a224-b53e0f2c476d req-713e67a3-5fff-4b5c-a170-5519da346422 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-55991e4c-81c0-4c58-a224-b53e0f2c476d req-713e67a3-5fff-4b5c-a170-5519da346422 service nova] Releasing lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquired lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] No VIF found with MAC fa:16:3e:f3:97:c8, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updating instance_info_cache with network_info: [{"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:30:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-97fa71b8-4ed3-494a-b356-7281549b4d47 tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.846s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Releasing lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Instance network_info: |[{"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Start _get_guest_xml network_info=[{"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:30:46 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:30:46 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1082839487',display_name='tempest-AttachVolumeNegativeTest-server-1082839487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1082839487',id=40,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX8klxfdjehzUiftqFuwbVM3fASnjnRN7OPqNuKNCdTbw5uKP6H8vAdBjeDUU+uLjUNwEyvwRlB6E5h/CwTBp30TkCXkt0MltTqwoLzVtWoe7c7Q9iypHo6y6zpGpOcNw==',key_name='tempest-keypair-470330138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-2qwj0wlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=44223f88-c27a-4240-a6c8-754379a66a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e5:fb,bridge_name='br-int',has_traffic_filtering=True,id=6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddc3be6-38') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'pci_devices' on Instance uuid 44223f88-c27a-4240-a6c8-754379a66a77 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:30:46 user nova-compute[76815]:   <uuid>44223f88-c27a-4240-a6c8-754379a66a77</uuid>
Nov 14 22:30:46 user nova-compute[76815]:   <name>instance-00000028</name>
Nov 14 22:30:46 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:30:46 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:30:46 user nova-compute[76815]:   <metadata>
Nov 14 22:30:46 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:30:46 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:30:46 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1082839487</nova:name>
Nov 14 22:30:46 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:30:46</nova:creationTime>
Nov 14 22:30:46 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:30:46 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:30:46 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:30:46 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:30:46 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:30:46 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:30:46 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:30:46 user nova-compute[76815]:       <nova:owner>
Nov 14 22:30:46 user nova-compute[76815]:         <nova:user uuid="26aadea3a6964715be30b0fbb2c61c6b">tempest-AttachVolumeNegativeTest-716641985-project-member</nova:user>
Nov 14 22:30:46 user nova-compute[76815]:         <nova:project uuid="fd690e5ff8584e2f9e24597816d90b98">tempest-AttachVolumeNegativeTest-716641985</nova:project>
Nov 14 22:30:46 user nova-compute[76815]:       </nova:owner>
Nov 14 22:30:46 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:30:46 user nova-compute[76815]:       <nova:ports>
Nov 14 22:30:46 user nova-compute[76815]:         <nova:port uuid="6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9">
Nov 14 22:30:46 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 22:30:46 user nova-compute[76815]:         </nova:port>
Nov 14 22:30:46 user nova-compute[76815]:       </nova:ports>
Nov 14 22:30:46 user nova-compute[76815]:     </nova:instance>
Nov 14 22:30:46 user nova-compute[76815]:   </metadata>
Nov 14 22:30:46 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:30:46 user nova-compute[76815]:     <system>
Nov 14 22:30:46 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:30:46 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:30:46 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:30:46 user nova-compute[76815]:       <entry name="serial">44223f88-c27a-4240-a6c8-754379a66a77</entry>
Nov 14 22:30:46 user nova-compute[76815]:       <entry name="uuid">44223f88-c27a-4240-a6c8-754379a66a77</entry>
Nov 14 22:30:46 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:30:46 user nova-compute[76815]:     </system>
Nov 14 22:30:46 user nova-compute[76815]:   </sysinfo>
Nov 14 22:30:46 user nova-compute[76815]:   <os>
Nov 14 22:30:46 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:30:46 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:30:46 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:30:46 user nova-compute[76815]:   </os>
Nov 14 22:30:46 user nova-compute[76815]:   <features>
Nov 14 22:30:46 user nova-compute[76815]:     <acpi/>
Nov 14 22:30:46 user nova-compute[76815]:     <apic/>
Nov 14 22:30:46 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:30:46 user nova-compute[76815]:   </features>
Nov 14 22:30:46 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:30:46 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:30:46 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:30:46 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:30:46 user nova-compute[76815]:   </clock>
Nov 14 22:30:46 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:30:46 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:30:46 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:30:46 user nova-compute[76815]:   </cpu>
Nov 14 22:30:46 user nova-compute[76815]:   <devices>
Nov 14 22:30:46 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:30:46 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:30:46 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk"/>
Nov 14 22:30:46 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:30:46 user nova-compute[76815]:     </disk>
Nov 14 22:30:46 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:30:46 user nova-compute[76815]:       <mac address="fa:16:3e:a7:e5:fb"/>
Nov 14 22:30:46 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:30:46 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:30:46 user nova-compute[76815]:       <target dev="tap6ddc3be6-38"/>
Nov 14 22:30:46 user nova-compute[76815]:     </interface>
Nov 14 22:30:46 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:30:46 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/console.log" append="off"/>
Nov 14 22:30:46 user nova-compute[76815]:     </serial>
Nov 14 22:30:46 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:30:46 user nova-compute[76815]:     <video>
Nov 14 22:30:46 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:30:46 user nova-compute[76815]:     </video>
Nov 14 22:30:46 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:30:46 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:30:46 user nova-compute[76815]:     </rng>
Nov 14 22:30:46 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:30:46 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:30:46 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:30:46 user nova-compute[76815]:     </memballoon>
Nov 14 22:30:46 user nova-compute[76815]:   </devices>
Nov 14 22:30:46 user nova-compute[76815]: </domain>
Nov 14 22:30:46 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1082839487',display_name='tempest-AttachVolumeNegativeTest-server-1082839487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1082839487',id=40,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX8klxfdjehzUiftqFuwbVM3fASnjnRN7OPqNuKNCdTbw5uKP6H8vAdBjeDUU+uLjUNwEyvwRlB6E5h/CwTBp30TkCXkt0MltTqwoLzVtWoe7c7Q9iypHo6y6zpGpOcNw==',key_name='tempest-keypair-470330138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-2qwj0wlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=44223f88-c27a-4240-a6c8-754379a66a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e5:fb,bridge_name='br-int',has_traffic_filtering=True,id=6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddc3be6-38') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG os_vif [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e5:fb,bridge_name='br-int',has_traffic_filtering=True,id=6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddc3be6-38') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e284735-51cf-57a1-bf6c-b9079d672bfb', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ddc3be6-38, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ddc3be6-38, col_values=(('qos', UUID('0eda05f3-bf4c-4464-9ae1-52c8239d0323')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ddc3be6-38, col_values=(('external_ids', {'iface-id': '6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:e5:fb', 'vm-uuid': '44223f88-c27a-4240-a6c8-754379a66a77'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:46 user nova-compute[76815]: INFO os_vif [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e5:fb,bridge_name='br-int',has_traffic_filtering=True,id=6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddc3be6-38')
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No VIF found with MAC fa:16:3e:a7:e5:fb, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:46 user nova-compute[76815]: INFO nova.compute.manager [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Detaching volume bbab3aea-c033-4ca0-bbd0-d44c7ff84218
Nov 14 22:30:47 user nova-compute[76815]: INFO nova.virt.block_device [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Attempting to driver detach volume bbab3aea-c033-4ca0-bbd0-d44c7ff84218 from mountpoint /dev/vdc
Nov 14 22:30:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Attempting to detach device vdc from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:30:47 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:30:47 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:30:47 user nova-compute[76815]:   <target dev="vdc" bus="virtio"/>
Nov 14 22:30:47 user nova-compute[76815]:   <serial>bbab3aea-c033-4ca0-bbd0-d44c7ff84218</serial>
Nov 14 22:30:47 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 22:30:47 user nova-compute[76815]: </disk>
Nov 14 22:30:47 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:30:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Successfully detached device vdc from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 from the persistent domain config.
Nov 14 22:30:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:30:47 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:30:47 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:30:47 user nova-compute[76815]:   <target dev="vdc" bus="virtio"/>
Nov 14 22:30:47 user nova-compute[76815]:   <serial>bbab3aea-c033-4ca0-bbd0-d44c7ff84218</serial>
Nov 14 22:30:47 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 22:30:47 user nova-compute[76815]: </disk>
Nov 14 22:30:47 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-41d881a1-8ead-4f48-810a-380e08c9986f req-76df7826-4aa8-4d9a-a776-4cda81081c9a service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received event network-vif-plugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-41d881a1-8ead-4f48-810a-380e08c9986f req-76df7826-4aa8-4d9a-a776-4cda81081c9a service nova] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-41d881a1-8ead-4f48-810a-380e08c9986f req-76df7826-4aa8-4d9a-a776-4cda81081c9a service nova] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-41d881a1-8ead-4f48-810a-380e08c9986f req-76df7826-4aa8-4d9a-a776-4cda81081c9a service nova] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-41d881a1-8ead-4f48-810a-380e08c9986f req-76df7826-4aa8-4d9a-a776-4cda81081c9a service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] No waiting events found dispatching network-vif-plugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:30:47 user nova-compute[76815]: WARNING nova.compute.manager [req-41d881a1-8ead-4f48-810a-380e08c9986f req-76df7826-4aa8-4d9a-a776-4cda81081c9a service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received unexpected event network-vif-plugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 for instance with vm_state building and task_state spawning.
Nov 14 22:30:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:30:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-e5853412-43c2-4448-bcdb-1c18beefb230 req-9f4d1e63-5431-4905-9785-83fea6d72083 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received event network-vif-plugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5853412-43c2-4448-bcdb-1c18beefb230 req-9f4d1e63-5431-4905-9785-83fea6d72083 service nova] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5853412-43c2-4448-bcdb-1c18beefb230 req-9f4d1e63-5431-4905-9785-83fea6d72083 service nova] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e5853412-43c2-4448-bcdb-1c18beefb230 req-9f4d1e63-5431-4905-9785-83fea6d72083 service nova] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-e5853412-43c2-4448-bcdb-1c18beefb230 req-9f4d1e63-5431-4905-9785-83fea6d72083 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] No waiting events found dispatching network-vif-plugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:30:49 user nova-compute[76815]: WARNING nova.compute.manager [req-e5853412-43c2-4448-bcdb-1c18beefb230 req-9f4d1e63-5431-4905-9785-83fea6d72083 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received unexpected event network-vif-plugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 for instance with vm_state building and task_state spawning.
Nov 14 22:30:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:30:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Instance spawned successfully.
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:30:49 user nova-compute[76815]: INFO nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 14 22:30:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:30:49 user nova-compute[76815]: INFO nova.compute.manager [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Took 6.57 seconds to build instance.
Nov 14 22:30:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f2a0d8f-8b7c-46a6-a8c9-b201a7ded3af tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.669s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid a8bb243d-ad93-47ae-8fbe-b5845a29496d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updating instance_info_cache with network_info: [{"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-a8bb243d-ad93-47ae-8fbe-b5845a29496d" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:50 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:53 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:30:57 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:30:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:07 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 is timed out.
Nov 14 22:31:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Successfully detached device vdc from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 from the live domain config.
Nov 14 22:31:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvyKfCzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:31:07 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d41dee-e7d9-4ebb-927d-e5da32d3f84e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:31:07 user nova-compute[76815]: No targets found.
Nov 14 22:31:07 user nova-compute[76815]: iSNS:
Nov 14 22:31:07 user nova-compute[76815]: No targets found.
Nov 14 22:31:07 user nova-compute[76815]: STATIC:
Nov 14 22:31:07 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:31:07 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:31:07 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:31:07 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218
Nov 14 22:31:07 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:31:07 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:31:07 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b
Nov 14 22:31:07 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:31:07 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:31:07 user nova-compute[76815]: FIRMWARE:
Nov 14 22:31:07 user nova-compute[76815]: No targets found.
Nov 14 22:31:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:31:07 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:31:07 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d75d9a-ebe4-4d44-a28d-849a958c61cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab37277-258f-4775-bea3-2ae1afc13616]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:31:07 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:31:07 user nova-compute[76815]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 (non-flash)
Nov 14 22:31:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:31:07 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:31:07 user nova-compute[76815]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 (non-flash)
Nov 14 22:31:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c862b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e4d09d-176d-48e9-ae83-91f05476f3e7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[288b401d-890d-44f2-b60b-f2b664fd1fb8]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c38551d-1b48-42b9-8b08-44b551997e88]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa20971-0bb5-44b6-9666-f3d5fb6e051e]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be290f87-965e-4e0f-9fdf-cecbda669768]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7619ba6-92e5-4fca-acf4-b60829a549a1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218, portal: 172.16.0.220,3260]
Nov 14 22:31:07 user nova-compute[76815]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218, portal: 172.16.0.220,3260] successful.
Nov 14 22:31:07 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbab3aea-c033-4ca0-bbd0-d44c7ff84218 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f38259-d139-40c7-b00c-fbdb61681496]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] <== disconnect_volume: return (292ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:31:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:31:08 user nova-compute[76815]: DEBUG nova.objects.instance [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lazy-loading 'flavor' on Instance uuid 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:31:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8f046d20-c1f7-49f6-8189-2047b63d27dd tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.814s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:10 user nova-compute[76815]: INFO nova.compute.manager [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Terminating instance
Nov 14 22:31:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:31:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-22498ad9-152e-4070-bbb9-8f1495adaa5f req-2c208680-fc7c-41f0-8c6e-ba777e02ab95 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-unplugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22498ad9-152e-4070-bbb9-8f1495adaa5f req-2c208680-fc7c-41f0-8c6e-ba777e02ab95 service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22498ad9-152e-4070-bbb9-8f1495adaa5f req-2c208680-fc7c-41f0-8c6e-ba777e02ab95 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22498ad9-152e-4070-bbb9-8f1495adaa5f req-2c208680-fc7c-41f0-8c6e-ba777e02ab95 service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-22498ad9-152e-4070-bbb9-8f1495adaa5f req-2c208680-fc7c-41f0-8c6e-ba777e02ab95 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-unplugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.compute.manager [req-22498ad9-152e-4070-bbb9-8f1495adaa5f req-2c208680-fc7c-41f0-8c6e-ba777e02ab95 service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-unplugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Instance destroyed successfully.
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.objects.instance [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'resources' on Instance uuid 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:15:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1163209102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1163209102',id=23,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-lgqcxfxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:19:12Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=0ba89777-a1fe-4754-9f3b-4e7a2daaa550,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "address": "fa:16:3e:42:73:ea", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap865be8f9-6f", "ovs_interfaceid": "865be8f9-6fe3-4bed-9d06-555efe17ed6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:73:ea,bridge_name='br-int',has_traffic_filtering=True,id=865be8f9-6fe3-4bed-9d06-555efe17ed6d,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865be8f9-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_vif [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:73:ea,bridge_name='br-int',has_traffic_filtering=True,id=865be8f9-6fe3-4bed-9d06-555efe17ed6d,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865be8f9-6f') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap865be8f9-6f, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ed4724d-1a86-42dc-8751-6db5da099e46) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:11 user nova-compute[76815]: INFO os_vif [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:73:ea,bridge_name='br-int',has_traffic_filtering=True,id=865be8f9-6fe3-4bed-9d06-555efe17ed6d,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap865be8f9-6f')
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMaLtgSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:31:11 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59203e13-2172-4148-ab60-72125d0e92c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:31:11 user nova-compute[76815]: No targets found.
Nov 14 22:31:11 user nova-compute[76815]: iSNS:
Nov 14 22:31:11 user nova-compute[76815]: No targets found.
Nov 14 22:31:11 user nova-compute[76815]: STATIC:
Nov 14 22:31:11 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd
Nov 14 22:31:11 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:31:11 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:31:11 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b
Nov 14 22:31:11 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:31:11 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:31:11 user nova-compute[76815]: FIRMWARE:
Nov 14 22:31:11 user nova-compute[76815]: No targets found.
Nov 14 22:31:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:31:11 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:31:11 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[866bc1a7-2705-4c27-858c-bb2d5638ac70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[79089676-ea8d-4b02-8789-8854355cae9e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:31:11 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:31:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd (non-flash)
Nov 14 22:31:11 user nova-compute[76815]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:31:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4536200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd'): ({'sdd'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Removing single pathed devices sdd {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe08bab5-5774-4fe0-ab4a-9a1999de8eb8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[91453c43-a5d5-4d34-bfe5-83d543809163]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Flushing IO for device /dev/sdd {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6ac06c-c877-4fb1-910b-c43e18edfdf5]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[38927646-300a-4523-addb-d0973affcdb7]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] SCSI volumes sdd have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac52351-083d-443e-8e97-d4b5fb846029]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be05440-eec8-4d86-8841-276771ae7f1d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd, portal: 172.16.0.220,3260]
Nov 14 22:31:11 user nova-compute[76815]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd, portal: 172.16.0.220,3260] successful.
Nov 14 22:31:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3bfd852-1215-49c7-81ef-eea070001bbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4e875-91f4-4546-ae33-d57179ff78df]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] <== disconnect_volume: return (294ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:31:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Deleting instance files /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550_del
Nov 14 22:31:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Deletion of /opt/stack/data/nova/instances/0ba89777-a1fe-4754-9f3b-4e7a2daaa550_del complete
Nov 14 22:31:11 user nova-compute[76815]: INFO nova.compute.manager [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 22:31:11 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:31:11 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:31:12 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:31:12 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Took 0.44 seconds to deallocate network for instance.
Nov 14 22:31:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-b45e0382-aa5b-4872-959b-a89d81e62e2e req-f192081a-faf4-4fcc-ae31-d8fcaeba083e service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-deleted-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:31:12 user nova-compute[76815]: INFO nova.compute.manager [req-b45e0382-aa5b-4872-959b-a89d81e62e2e req-f192081a-faf4-4fcc-ae31-d8fcaeba083e service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Neutron deleted interface 865be8f9-6fe3-4bed-9d06-555efe17ed6d; detaching it from the instance and deleting it from the info cache
Nov 14 22:31:12 user nova-compute[76815]: DEBUG nova.network.neutron [req-b45e0382-aa5b-4872-959b-a89d81e62e2e req-f192081a-faf4-4fcc-ae31-d8fcaeba083e service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:31:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-b45e0382-aa5b-4872-959b-a89d81e62e2e req-f192081a-faf4-4fcc-ae31-d8fcaeba083e service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Detach interface failed, port_id=865be8f9-6fe3-4bed-9d06-555efe17ed6d, reason: Instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:31:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:12 user nova-compute[76815]: INFO nova.compute.manager [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 22:31:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:13 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:31:13 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:31:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:13 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Deleted allocations for instance 0ba89777-a1fe-4754-9f3b-4e7a2daaa550
Nov 14 22:31:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-e95f426a-9365-4a5e-9458-9eb43d031f3f req-a5027dda-eaf5-4005-a8ed-9e98bfed886f service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:31:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e95f426a-9365-4a5e-9458-9eb43d031f3f req-a5027dda-eaf5-4005-a8ed-9e98bfed886f service nova] Acquiring lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e95f426a-9365-4a5e-9458-9eb43d031f3f req-a5027dda-eaf5-4005-a8ed-9e98bfed886f service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e95f426a-9365-4a5e-9458-9eb43d031f3f req-a5027dda-eaf5-4005-a8ed-9e98bfed886f service nova] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:13 user nova-compute[76815]: DEBUG nova.compute.manager [req-e95f426a-9365-4a5e-9458-9eb43d031f3f req-a5027dda-eaf5-4005-a8ed-9e98bfed886f service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] No waiting events found dispatching network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:31:13 user nova-compute[76815]: WARNING nova.compute.manager [req-e95f426a-9365-4a5e-9458-9eb43d031f3f req-a5027dda-eaf5-4005-a8ed-9e98bfed886f service nova] [instance: 0ba89777-a1fe-4754-9f3b-4e7a2daaa550] Received unexpected event network-vif-plugged-865be8f9-6fe3-4bed-9d06-555efe17ed6d for instance with vm_state deleted and task_state None.
Nov 14 22:31:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-60b7bf14-fa23-4aa6-9afb-b858b4971965 tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "0ba89777-a1fe-4754-9f3b-4e7a2daaa550" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:31:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:31:31 user nova-compute[76815]: INFO nova.compute.claims [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Claim successful on node user
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.network.neutron [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:31:31 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.policy [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3590183279e742f0bced96008d784cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ac882a01d4abfa130458292b5cd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:31:31 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Creating image(s)
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "/opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "/opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "/opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk 1073741824" returned: 0 in 0.074s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.network.neutron [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Successfully created port: ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Cannot resize image /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Ensure instance console log exists: /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.network.neutron [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Successfully updated port: ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquired lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.network.neutron [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-f7c6d050-6947-4764-bb59-322c879cf242 req-f4508b62-7c1d-403d-801a-185a8bcb12e8 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-changed-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-f7c6d050-6947-4764-bb59-322c879cf242 req-f4508b62-7c1d-403d-801a-185a8bcb12e8 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Refreshing instance network info cache due to event network-changed-ecc05760-8b9f-47c6-aa52-6ada01978b59. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7c6d050-6947-4764-bb59-322c879cf242 req-f4508b62-7c1d-403d-801a-185a8bcb12e8 service nova] Acquiring lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:31:32 user nova-compute[76815]: DEBUG nova.network.neutron [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.network.neutron [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updating instance_info_cache with network_info: [{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Releasing lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance network_info: |[{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7c6d050-6947-4764-bb59-322c879cf242 req-f4508b62-7c1d-403d-801a-185a8bcb12e8 service nova] Acquired lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.network.neutron [req-f7c6d050-6947-4764-bb59-322c879cf242 req-f4508b62-7c1d-403d-801a-185a8bcb12e8 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Refreshing network info cache for port ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Start _get_guest_xml network_info=[{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:31:33 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:31:33 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-88532880',display_name='tempest-AttachVolumeTestJSON-server-88532880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-88532880',id=41,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQubaL4MRQuzJoCVwamFoNIlvVZWcGCwACqD1aiy1LaEn8qAs7tkZ5TTctrQdfL2x8ZstSYKMLnmOAaQmEsNBAZvuRmZsqzswxqjPsbJlZXq1ikUWRFm/k6lX6ZPoGyzg==',key_name='tempest-keypair-2014797013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-436ixbo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:31:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=4726306c-2d1d-4395-af5c-bcb631d47e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.objects.instance [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'pci_devices' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:31:33 user nova-compute[76815]:   <uuid>4726306c-2d1d-4395-af5c-bcb631d47e3a</uuid>
Nov 14 22:31:33 user nova-compute[76815]:   <name>instance-00000029</name>
Nov 14 22:31:33 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:31:33 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:31:33 user nova-compute[76815]:   <metadata>
Nov 14 22:31:33 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:31:33 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:31:33 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeTestJSON-server-88532880</nova:name>
Nov 14 22:31:33 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:31:33</nova:creationTime>
Nov 14 22:31:33 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:31:33 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:31:33 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:31:33 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:31:33 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:31:33 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:31:33 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:31:33 user nova-compute[76815]:       <nova:owner>
Nov 14 22:31:33 user nova-compute[76815]:         <nova:user uuid="3590183279e742f0bced96008d784cfb">tempest-AttachVolumeTestJSON-252609817-project-member</nova:user>
Nov 14 22:31:33 user nova-compute[76815]:         <nova:project uuid="e13ac882a01d4abfa130458292b5cd40">tempest-AttachVolumeTestJSON-252609817</nova:project>
Nov 14 22:31:33 user nova-compute[76815]:       </nova:owner>
Nov 14 22:31:33 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:31:33 user nova-compute[76815]:       <nova:ports>
Nov 14 22:31:33 user nova-compute[76815]:         <nova:port uuid="ecc05760-8b9f-47c6-aa52-6ada01978b59">
Nov 14 22:31:33 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:31:33 user nova-compute[76815]:         </nova:port>
Nov 14 22:31:33 user nova-compute[76815]:       </nova:ports>
Nov 14 22:31:33 user nova-compute[76815]:     </nova:instance>
Nov 14 22:31:33 user nova-compute[76815]:   </metadata>
Nov 14 22:31:33 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:31:33 user nova-compute[76815]:     <system>
Nov 14 22:31:33 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:31:33 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:31:33 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:31:33 user nova-compute[76815]:       <entry name="serial">4726306c-2d1d-4395-af5c-bcb631d47e3a</entry>
Nov 14 22:31:33 user nova-compute[76815]:       <entry name="uuid">4726306c-2d1d-4395-af5c-bcb631d47e3a</entry>
Nov 14 22:31:33 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:31:33 user nova-compute[76815]:     </system>
Nov 14 22:31:33 user nova-compute[76815]:   </sysinfo>
Nov 14 22:31:33 user nova-compute[76815]:   <os>
Nov 14 22:31:33 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:31:33 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:31:33 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:31:33 user nova-compute[76815]:   </os>
Nov 14 22:31:33 user nova-compute[76815]:   <features>
Nov 14 22:31:33 user nova-compute[76815]:     <acpi/>
Nov 14 22:31:33 user nova-compute[76815]:     <apic/>
Nov 14 22:31:33 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:31:33 user nova-compute[76815]:   </features>
Nov 14 22:31:33 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:31:33 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:31:33 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:31:33 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:31:33 user nova-compute[76815]:   </clock>
Nov 14 22:31:33 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:31:33 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:31:33 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:31:33 user nova-compute[76815]:   </cpu>
Nov 14 22:31:33 user nova-compute[76815]:   <devices>
Nov 14 22:31:33 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:31:33 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:31:33 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk"/>
Nov 14 22:31:33 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:31:33 user nova-compute[76815]:     </disk>
Nov 14 22:31:33 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:31:33 user nova-compute[76815]:       <mac address="fa:16:3e:c4:49:e2"/>
Nov 14 22:31:33 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:31:33 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:31:33 user nova-compute[76815]:       <target dev="tapecc05760-8b"/>
Nov 14 22:31:33 user nova-compute[76815]:     </interface>
Nov 14 22:31:33 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:31:33 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/console.log" append="off"/>
Nov 14 22:31:33 user nova-compute[76815]:     </serial>
Nov 14 22:31:33 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:31:33 user nova-compute[76815]:     <video>
Nov 14 22:31:33 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:31:33 user nova-compute[76815]:     </video>
Nov 14 22:31:33 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:31:33 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:31:33 user nova-compute[76815]:     </rng>
Nov 14 22:31:33 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:31:33 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:31:33 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:31:33 user nova-compute[76815]:     </memballoon>
Nov 14 22:31:33 user nova-compute[76815]:   </devices>
Nov 14 22:31:33 user nova-compute[76815]: </domain>
Nov 14 22:31:33 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-88532880',display_name='tempest-AttachVolumeTestJSON-server-88532880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-88532880',id=41,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQubaL4MRQuzJoCVwamFoNIlvVZWcGCwACqD1aiy1LaEn8qAs7tkZ5TTctrQdfL2x8ZstSYKMLnmOAaQmEsNBAZvuRmZsqzswxqjPsbJlZXq1ikUWRFm/k6lX6ZPoGyzg==',key_name='tempest-keypair-2014797013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-436ixbo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:31:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=4726306c-2d1d-4395-af5c-bcb631d47e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG os_vif [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd63c7f9d-8750-5959-902c-5a9bfc124e22', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecc05760-8b, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecc05760-8b, col_values=(('qos', UUID('d5501186-9467-418a-8623-c3587f7a10ca')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecc05760-8b, col_values=(('external_ids', {'iface-id': 'ecc05760-8b9f-47c6-aa52-6ada01978b59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:49:e2', 'vm-uuid': '4726306c-2d1d-4395-af5c-bcb631d47e3a'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:33 user nova-compute[76815]: INFO os_vif [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b')
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No VIF found with MAC fa:16:3e:c4:49:e2, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.network.neutron [req-f7c6d050-6947-4764-bb59-322c879cf242 req-f4508b62-7c1d-403d-801a-185a8bcb12e8 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updated VIF entry in instance network info cache for port ecc05760-8b9f-47c6-aa52-6ada01978b59. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG nova.network.neutron [req-f7c6d050-6947-4764-bb59-322c879cf242 req-f4508b62-7c1d-403d-801a-185a8bcb12e8 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updating instance_info_cache with network_info: [{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:31:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7c6d050-6947-4764-bb59-322c879cf242 req-f4508b62-7c1d-403d-801a-185a8bcb12e8 service nova] Releasing lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:31:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-968ae310-3c6e-408d-98f6-da3e15fa9c27 req-24b3586b-6db1-4811-a92f-c24e42254099 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:31:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-968ae310-3c6e-408d-98f6-da3e15fa9c27 req-24b3586b-6db1-4811-a92f-c24e42254099 service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-968ae310-3c6e-408d-98f6-da3e15fa9c27 req-24b3586b-6db1-4811-a92f-c24e42254099 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-968ae310-3c6e-408d-98f6-da3e15fa9c27 req-24b3586b-6db1-4811-a92f-c24e42254099 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-968ae310-3c6e-408d-98f6-da3e15fa9c27 req-24b3586b-6db1-4811-a92f-c24e42254099 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:31:34 user nova-compute[76815]: WARNING nova.compute.manager [req-968ae310-3c6e-408d-98f6-da3e15fa9c27 req-24b3586b-6db1-4811-a92f-c24e42254099 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state building and task_state spawning.
Nov 14 22:31:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:31:36 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance spawned successfully.
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-c2a80df4-a843-4efd-a6ff-a3c77aee0b36 req-d1def8fa-6a25-44a4-a773-5ef8b2febc3f service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c2a80df4-a843-4efd-a6ff-a3c77aee0b36 req-d1def8fa-6a25-44a4-a773-5ef8b2febc3f service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c2a80df4-a843-4efd-a6ff-a3c77aee0b36 req-d1def8fa-6a25-44a4-a773-5ef8b2febc3f service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c2a80df4-a843-4efd-a6ff-a3c77aee0b36 req-d1def8fa-6a25-44a4-a773-5ef8b2febc3f service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-c2a80df4-a843-4efd-a6ff-a3c77aee0b36 req-d1def8fa-6a25-44a4-a773-5ef8b2febc3f service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:31:36 user nova-compute[76815]: WARNING nova.compute.manager [req-c2a80df4-a843-4efd-a6ff-a3c77aee0b36 req-d1def8fa-6a25-44a4-a773-5ef8b2febc3f service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state building and task_state spawning.
Nov 14 22:31:36 user nova-compute[76815]: INFO nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 14 22:31:36 user nova-compute[76815]: DEBUG nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:31:36 user nova-compute[76815]: INFO nova.compute.manager [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Took 5.68 seconds to build instance.
Nov 14 22:31:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-29594ddd-1f29-4159-a38d-5f7e104c70e5 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.784s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:37 user nova-compute[76815]: INFO nova.compute.manager [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Detaching volume bc939797-3a7e-491c-9e5e-35f9ea81c64b
Nov 14 22:31:37 user nova-compute[76815]: INFO nova.virt.block_device [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Attempting to driver detach volume bc939797-3a7e-491c-9e5e-35f9ea81c64b from mountpoint /dev/vdb
Nov 14 22:31:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Attempting to detach device vdb from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:31:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:31:37 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:31:37 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:31:37 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:31:37 user nova-compute[76815]:   <serial>bc939797-3a7e-491c-9e5e-35f9ea81c64b</serial>
Nov 14 22:31:37 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:31:37 user nova-compute[76815]: </disk>
Nov 14 22:31:37 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:31:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Successfully detached device vdb from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 from the persistent domain config.
Nov 14 22:31:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:31:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:31:37 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:31:37 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:31:37 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:31:37 user nova-compute[76815]:   <serial>bc939797-3a7e-491c-9e5e-35f9ea81c64b</serial>
Nov 14 22:31:37 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:31:37 user nova-compute[76815]: </disk>
Nov 14 22:31:37 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:31:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:31:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:31:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:31:47 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8594MB free_disk=24.974891662597656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:31:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:31:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance a8bb243d-ad93-47ae-8fbe-b5845a29496d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44223f88-c27a-4240-a6c8-754379a66a77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:31:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Updating instance_info_cache with network_info: [{"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-91c8b85c-76f1-43ca-876f-575dafa1bc35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:31:52 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:31:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:31:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:58 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 is timed out.
Nov 14 22:31:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Successfully detached device vdb from instance 91c8b85c-76f1-43ca-876f-575dafa1bc35 from the live domain config.
Nov 14 22:31:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HICLsRUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:31:58 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[db87d8e0-039f-494c-8e9e-9b7061d40d81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:31:58 user nova-compute[76815]: No targets found.
Nov 14 22:31:58 user nova-compute[76815]: iSNS:
Nov 14 22:31:58 user nova-compute[76815]: No targets found.
Nov 14 22:31:58 user nova-compute[76815]: STATIC:
Nov 14 22:31:58 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b
Nov 14 22:31:58 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:31:58 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:31:58 user nova-compute[76815]: FIRMWARE:
Nov 14 22:31:58 user nova-compute[76815]: No targets found.
Nov 14 22:31:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:31:58 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:31:58 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0183f303-ee1b-4660-a0cb-96612b48706b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1bbd2d-373e-4319-b6e9-be51f6515626]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:31:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b (non-flash)
Nov 14 22:31:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a45879a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae822eee-b2a7-43ec-adac-e131153e760d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbcd8f3-23cc-4f67-9d1c-a82952479a10]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6e0c3c-1df3-4b84-a730-5cf921d3e94e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e7f5e8-8d8f-4b1f-9e6a-59c2e53f0395]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba6841-40e3-4f5a-a512-d9b62865edca]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1042ef95-25d2-4ef6-8359-8e161d1cb77d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b, portal: 172.16.0.220,3260]
Nov 14 22:31:58 user nova-compute[76815]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b, portal: 172.16.0.220,3260] successful.
Nov 14 22:31:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc939797-3a7e-491c-9e5e-35f9ea81c64b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15185f0-a2c9-4f1e-805f-7b859dbba327]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] <== disconnect_volume: return (290ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:31:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:31:59 user nova-compute[76815]: DEBUG nova.objects.instance [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lazy-loading 'flavor' on Instance uuid 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:31:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dff0fcd4-91be-4176-8272-836436f6dd9d tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.660s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.007s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:01 user nova-compute[76815]: INFO nova.compute.manager [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Terminating instance
Nov 14 22:32:01 user nova-compute[76815]: DEBUG nova.compute.manager [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG nova.compute.manager [req-b61666ff-53f3-4b3e-a6ef-a60896e46c48 req-d6a1a438-dfbb-4836-a2cd-1188895d94f7 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received event network-vif-unplugged-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b61666ff-53f3-4b3e-a6ef-a60896e46c48 req-d6a1a438-dfbb-4836-a2cd-1188895d94f7 service nova] Acquiring lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b61666ff-53f3-4b3e-a6ef-a60896e46c48 req-d6a1a438-dfbb-4836-a2cd-1188895d94f7 service nova] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b61666ff-53f3-4b3e-a6ef-a60896e46c48 req-d6a1a438-dfbb-4836-a2cd-1188895d94f7 service nova] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG nova.compute.manager [req-b61666ff-53f3-4b3e-a6ef-a60896e46c48 req-d6a1a438-dfbb-4836-a2cd-1188895d94f7 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] No waiting events found dispatching network-vif-unplugged-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:32:01 user nova-compute[76815]: DEBUG nova.compute.manager [req-b61666ff-53f3-4b3e-a6ef-a60896e46c48 req-d6a1a438-dfbb-4836-a2cd-1188895d94f7 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received event network-vif-unplugged-2c08b739-bf8a-4e86-ae64-9afa96802414 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:02 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Instance destroyed successfully.
Nov 14 22:32:02 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lazy-loading 'resources' on Instance uuid a8bb243d-ad93-47ae-8fbe-b5845a29496d {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1919742082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1919742082',id=14,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:11:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='327b9fb17cb74bb0a56380b0d084cec3',ramdisk_id='',reservation_id='r-9byn0070',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-890378304',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:13:33Z,user_data=None,user_id='a6ef0744ff3b459b9e32404ec12bbe55',uuid=a8bb243d-ad93-47ae-8fbe-b5845a29496d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converting VIF {"id": "2c08b739-bf8a-4e86-ae64-9afa96802414", "address": "fa:16:3e:e5:e4:d1", "network": {"id": "c811a314-3de7-4fc6-bcb4-525c77a3cba2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-830408856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327b9fb17cb74bb0a56380b0d084cec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c08b739-bf", "ovs_interfaceid": "2c08b739-bf8a-4e86-ae64-9afa96802414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e4:d1,bridge_name='br-int',has_traffic_filtering=True,id=2c08b739-bf8a-4e86-ae64-9afa96802414,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c08b739-bf') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG os_vif [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e4:d1,bridge_name='br-int',has_traffic_filtering=True,id=2c08b739-bf8a-4e86-ae64-9afa96802414,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c08b739-bf') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c08b739-bf, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad7ca9dd-dc43-4264-8c5a-4ea7f063d7da) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:02 user nova-compute[76815]: INFO os_vif [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:e4:d1,bridge_name='br-int',has_traffic_filtering=True,id=2c08b739-bf8a-4e86-ae64-9afa96802414,network=Network(c811a314-3de7-4fc6-bcb4-525c77a3cba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c08b739-bf')
Nov 14 22:32:02 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Deleting instance files /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d_del
Nov 14 22:32:02 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Deletion of /opt/stack/data/nova/instances/a8bb243d-ad93-47ae-8fbe-b5845a29496d_del complete
Nov 14 22:32:02 user nova-compute[76815]: INFO nova.compute.manager [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 22:32:02 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:32:02 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Took 0.42 seconds to deallocate network for instance.
Nov 14 22:32:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:03 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:32:03 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:32:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:03 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Deleted allocations for instance a8bb243d-ad93-47ae-8fbe-b5845a29496d
Nov 14 22:32:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e27b5b93-1357-4f5c-990a-69f73d161eac tempest-ServerBootFromVolumeStableRescueTest-890378304 tempest-ServerBootFromVolumeStableRescueTest-890378304-project-member] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.682s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-c01c1d02-1dab-466a-b573-caef8cb0c4cf req-2b9c73d1-d806-4d01-8cfd-52b829a852a1 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received event network-vif-plugged-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c01c1d02-1dab-466a-b573-caef8cb0c4cf req-2b9c73d1-d806-4d01-8cfd-52b829a852a1 service nova] Acquiring lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c01c1d02-1dab-466a-b573-caef8cb0c4cf req-2b9c73d1-d806-4d01-8cfd-52b829a852a1 service nova] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c01c1d02-1dab-466a-b573-caef8cb0c4cf req-2b9c73d1-d806-4d01-8cfd-52b829a852a1 service nova] Lock "a8bb243d-ad93-47ae-8fbe-b5845a29496d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-c01c1d02-1dab-466a-b573-caef8cb0c4cf req-2b9c73d1-d806-4d01-8cfd-52b829a852a1 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] No waiting events found dispatching network-vif-plugged-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:32:03 user nova-compute[76815]: WARNING nova.compute.manager [req-c01c1d02-1dab-466a-b573-caef8cb0c4cf req-2b9c73d1-d806-4d01-8cfd-52b829a852a1 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received unexpected event network-vif-plugged-2c08b739-bf8a-4e86-ae64-9afa96802414 for instance with vm_state deleted and task_state None.
Nov 14 22:32:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-c01c1d02-1dab-466a-b573-caef8cb0c4cf req-2b9c73d1-d806-4d01-8cfd-52b829a852a1 service nova] [instance: a8bb243d-ad93-47ae-8fbe-b5845a29496d] Received event network-vif-deleted-2c08b739-bf8a-4e86-ae64-9afa96802414 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:32:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:27 user nova-compute[76815]: INFO nova.compute.manager [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Terminating instance
Nov 14 22:32:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-e644b938-762a-41a8-8513-1e7c4da75d6a req-f8df6a05-35c4-4003-a82b-c3f98889327b service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received event network-vif-unplugged-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e644b938-762a-41a8-8513-1e7c4da75d6a req-f8df6a05-35c4-4003-a82b-c3f98889327b service nova] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e644b938-762a-41a8-8513-1e7c4da75d6a req-f8df6a05-35c4-4003-a82b-c3f98889327b service nova] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e644b938-762a-41a8-8513-1e7c4da75d6a req-f8df6a05-35c4-4003-a82b-c3f98889327b service nova] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-e644b938-762a-41a8-8513-1e7c4da75d6a req-f8df6a05-35c4-4003-a82b-c3f98889327b service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] No waiting events found dispatching network-vif-unplugged-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-e644b938-762a-41a8-8513-1e7c4da75d6a req-f8df6a05-35c4-4003-a82b-c3f98889327b service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received event network-vif-unplugged-dc142a4c-50db-4289-b438-effe10f42347 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:32:28 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Instance destroyed successfully.
Nov 14 22:32:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lazy-loading 'resources' on Instance uuid 91c8b85c-76f1-43ca-876f-575dafa1bc35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:28:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2028164980',display_name='tempest-TestServerVolumeAttachmentScenario-server-2028164980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2028164980',id=39,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnHA9rcrkESm32uBdG19iviRb0dPSZM28YoWLdwUyr/L94yMVpS7OctREPOOlpk4+7MtY5RPZy107XWaX1cp3lM7qX3La5pLVAQgMm7f7S9G8fhDJTOV+MvRxqbl9V93Q==',key_name='tempest-keypair-1375725796',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:28:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf640863b51d408cb9c9a0e94e7b77bb',ramdisk_id='',reservation_id='r-kbqfspn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1804795114',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1804795114-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:28:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f8e1c6f785d4f93ab73089de17904f4',uuid=91c8b85c-76f1-43ca-876f-575dafa1bc35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Converting VIF {"id": "dc142a4c-50db-4289-b438-effe10f42347", "address": "fa:16:3e:f3:97:c8", "network": {"id": "508950bd-5aa8-4d80-83cb-1559deb1f65b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1588256169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf640863b51d408cb9c9a0e94e7b77bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc142a4c-50", "ovs_interfaceid": "dc142a4c-50db-4289-b438-effe10f42347", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:97:c8,bridge_name='br-int',has_traffic_filtering=True,id=dc142a4c-50db-4289-b438-effe10f42347,network=Network(508950bd-5aa8-4d80-83cb-1559deb1f65b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc142a4c-50') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG os_vif [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:97:c8,bridge_name='br-int',has_traffic_filtering=True,id=dc142a4c-50db-4289-b438-effe10f42347,network=Network(508950bd-5aa8-4d80-83cb-1559deb1f65b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc142a4c-50') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc142a4c-50, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15a8c861-16c6-4559-a575-c34fff4795d5) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:32:28 user nova-compute[76815]: INFO os_vif [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:97:c8,bridge_name='br-int',has_traffic_filtering=True,id=dc142a4c-50db-4289-b438-effe10f42347,network=Network(508950bd-5aa8-4d80-83cb-1559deb1f65b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc142a4c-50')
Nov 14 22:32:28 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Deleting instance files /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35_del
Nov 14 22:32:28 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Deletion of /opt/stack/data/nova/instances/91c8b85c-76f1-43ca-876f-575dafa1bc35_del complete
Nov 14 22:32:28 user nova-compute[76815]: INFO nova.compute.manager [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 14 22:32:28 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:32:28 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:32:29 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:32:29 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Took 0.65 seconds to deallocate network for instance.
Nov 14 22:32:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-849b527b-a21b-4957-8d8d-1c0f541b3d9d req-49b5ac96-99be-4f5a-958e-8f50c4fba882 service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received event network-vif-deleted-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:29 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:32:29 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:32:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:29 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Deleted allocations for instance 91c8b85c-76f1-43ca-876f-575dafa1bc35
Nov 14 22:32:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-49cf821b-7951-4ee2-bf48-8f1cc4a874ca tempest-TestServerVolumeAttachmentScenario-1804795114 tempest-TestServerVolumeAttachmentScenario-1804795114-project-member] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-c489ebc4-903f-4d92-8405-1122ae80bbd6 req-217ccee7-9601-4512-80e1-dcbf55858f93 service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received event network-vif-plugged-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c489ebc4-903f-4d92-8405-1122ae80bbd6 req-217ccee7-9601-4512-80e1-dcbf55858f93 service nova] Acquiring lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c489ebc4-903f-4d92-8405-1122ae80bbd6 req-217ccee7-9601-4512-80e1-dcbf55858f93 service nova] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c489ebc4-903f-4d92-8405-1122ae80bbd6 req-217ccee7-9601-4512-80e1-dcbf55858f93 service nova] Lock "91c8b85c-76f1-43ca-876f-575dafa1bc35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-c489ebc4-903f-4d92-8405-1122ae80bbd6 req-217ccee7-9601-4512-80e1-dcbf55858f93 service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] No waiting events found dispatching network-vif-plugged-dc142a4c-50db-4289-b438-effe10f42347 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:32:30 user nova-compute[76815]: WARNING nova.compute.manager [req-c489ebc4-903f-4d92-8405-1122ae80bbd6 req-217ccee7-9601-4512-80e1-dcbf55858f93 service nova] [instance: 91c8b85c-76f1-43ca-876f-575dafa1bc35] Received unexpected event network-vif-plugged-dc142a4c-50db-4289-b438-effe10f42347 for instance with vm_state deleted and task_state None.
Nov 14 22:32:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-edb9d6e2-333a-49e6-98c5-e646f5e6da1a req-b372ae11-74dc-46bd-aa3c-6bea9af10fe9 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received event network-changed-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-edb9d6e2-333a-49e6-98c5-e646f5e6da1a req-b372ae11-74dc-46bd-aa3c-6bea9af10fe9 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Refreshing instance network info cache due to event network-changed-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:32:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-edb9d6e2-333a-49e6-98c5-e646f5e6da1a req-b372ae11-74dc-46bd-aa3c-6bea9af10fe9 service nova] Acquiring lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:32:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-edb9d6e2-333a-49e6-98c5-e646f5e6da1a req-b372ae11-74dc-46bd-aa3c-6bea9af10fe9 service nova] Acquired lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:32:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-edb9d6e2-333a-49e6-98c5-e646f5e6da1a req-b372ae11-74dc-46bd-aa3c-6bea9af10fe9 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Refreshing network info cache for port 6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:32:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-edb9d6e2-333a-49e6-98c5-e646f5e6da1a req-b372ae11-74dc-46bd-aa3c-6bea9af10fe9 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updated VIF entry in instance network info cache for port 6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:32:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-edb9d6e2-333a-49e6-98c5-e646f5e6da1a req-b372ae11-74dc-46bd-aa3c-6bea9af10fe9 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updating instance_info_cache with network_info: [{"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:32:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-edb9d6e2-333a-49e6-98c5-e646f5e6da1a req-b372ae11-74dc-46bd-aa3c-6bea9af10fe9 service nova] Releasing lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'flavor' on Instance uuid 44223f88-c27a-4240-a6c8-754379a66a77 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:37 user nova-compute[76815]: INFO nova.compute.manager [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Attaching volume 3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 to /dev/vdb
Nov 14 22:32:37 user nova-compute[76815]: DEBUG os_brick.utils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb74f936-0010-4319-be67-7df1313a7229]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc54ade7-7ba5-4448-99ce-3b17a9c19c84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[562a06db-769a-4f0e-904c-6dc09698bc67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f8772a-ac26-42d5-bd9e-0017db72c42b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:32:37 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:32:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7257782-b9ca-466a-b091-b1bb28d5e451]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG os_brick.utils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updating existing volume attachment record: 4f2fb2e8-1386-4944-94e9-51b2b5ffc666 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:32:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xepoilHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:32:41 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:32:41 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:32:41 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be82a71d-effa-42ed-9077-010a48674d0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:32:41 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8cc6b1-4bd7-40f2-969e-9bfd9f8339b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78] added
Nov 14 22:32:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c478fd8-f436-4137-b852-70ceaf1a34f0]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c9b947-492c-4cc9-9523-9591347dd13d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xepoilHa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xepoilHa" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff8640f-7d2c-416d-aedd-569f93944991]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xepoilHa'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f23df-a187-4a6e-a557-cbfeae8f3b81]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d349895-f7b4-452c-bf61-09bc9c802b8d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:32:41 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:32:41 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:32:41 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:32:41 user nova-compute[76815]: 
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91549e4-5e83-4805-ab70-613b1ec1d882]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78, portal: 172.16.0.220,3260]
Nov 14 22:32:41 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78, portal: 172.16.0.220,3260] successful.
Nov 14 22:32:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8983adcb-0360-4f78-b6c4-a59459c2464d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b509156-dc29-4647-8146-31d471276fe1]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:32:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:32:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bbc951-d2c3-4ff8-9f21-f652b8cf11e3]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:32:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:32:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:32:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xepoilHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:32:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:32:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23766343634646238', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:32:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766343634646238', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:32:42 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'flavor' on Instance uuid 44223f88-c27a-4240-a6c8-754379a66a77 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:32:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:32:42 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:32:42 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:32:42 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:32:42 user nova-compute[76815]:   <serial>3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78</serial>
Nov 14 22:32:42 user nova-compute[76815]: </disk>
Nov 14 22:32:42 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:32:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:32:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:32:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No VIF found with MAC fa:16:3e:a7:e5:fb, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:32:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e0784cf7-4bfd-48b2-83ff-6baff91ebe4f tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.167s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "aa018561-b7b2-464e-a340-07fb476a8685" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "aa018561-b7b2-464e-a340-07fb476a8685" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:32:46 user nova-compute[76815]: INFO nova.compute.claims [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Claim successful on node user
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:32:46 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.policy [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26aadea3a6964715be30b0fbb2c61c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd690e5ff8584e2f9e24597816d90b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:32:46 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Creating image(s)
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "/opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "/opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk 1073741824" returned: 0 in 0.208s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Successfully created port: 9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Cannot resize image /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Ensure instance console log exists: /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:32:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Successfully updated port: 9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-61c1f2a4-8188-413b-b6bf-79a4c5097227 req-6eadd1c3-f5a1-4772-b653-ed87dd1ec3da service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received event network-changed-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-61c1f2a4-8188-413b-b6bf-79a4c5097227 req-6eadd1c3-f5a1-4772-b653-ed87dd1ec3da service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Refreshing instance network info cache due to event network-changed-9a148119-c074-4ba6-90f7-a7418ea8704f. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-61c1f2a4-8188-413b-b6bf-79a4c5097227 req-6eadd1c3-f5a1-4772-b653-ed87dd1ec3da service nova] Acquiring lock "refresh_cache-aa018561-b7b2-464e-a340-07fb476a8685" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-61c1f2a4-8188-413b-b6bf-79a4c5097227 req-6eadd1c3-f5a1-4772-b653-ed87dd1ec3da service nova] Acquired lock "refresh_cache-aa018561-b7b2-464e-a340-07fb476a8685" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-61c1f2a4-8188-413b-b6bf-79a4c5097227 req-6eadd1c3-f5a1-4772-b653-ed87dd1ec3da service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Refreshing network info cache for port 9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:32:48 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:32:48 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.090721130371094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "refresh_cache-aa018561-b7b2-464e-a340-07fb476a8685" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-61c1f2a4-8188-413b-b6bf-79a4c5097227 req-6eadd1c3-f5a1-4772-b653-ed87dd1ec3da service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44223f88-c27a-4240-a6c8-754379a66a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance aa018561-b7b2-464e-a340-07fb476a8685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-61c1f2a4-8188-413b-b6bf-79a4c5097227 req-6eadd1c3-f5a1-4772-b653-ed87dd1ec3da service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-61c1f2a4-8188-413b-b6bf-79a4c5097227 req-6eadd1c3-f5a1-4772-b653-ed87dd1ec3da service nova] Releasing lock "refresh_cache-aa018561-b7b2-464e-a340-07fb476a8685" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquired lock "refresh_cache-aa018561-b7b2-464e-a340-07fb476a8685" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.neutron [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Updating instance_info_cache with network_info: [{"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Releasing lock "refresh_cache-aa018561-b7b2-464e-a340-07fb476a8685" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Instance network_info: |[{"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Start _get_guest_xml network_info=[{"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:32:48 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:32:48 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911769233',display_name='tempest-AttachVolumeNegativeTest-server-1911769233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911769233',id=42,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJB5cClOz8WZK11zgeFVWVZQCn0Ngy13p8XIHbLbJatXSk8q2zKfvnAMzLQ2hhv7ox3DB3Sb1HKY4Mu0/GWpTurgqWOUrMZWqDsXkH2oT0gLPUjochOzen30+PSe0siuA==',key_name='tempest-keypair-1007656382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-jhcvmke3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=aa018561-b7b2-464e-a340-07fb476a8685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f1:60,bridge_name='br-int',has_traffic_filtering=True,id=9a148119-c074-4ba6-90f7-a7418ea8704f,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a148119-c0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'pci_devices' on Instance uuid aa018561-b7b2-464e-a340-07fb476a8685 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:32:48 user nova-compute[76815]:   <uuid>aa018561-b7b2-464e-a340-07fb476a8685</uuid>
Nov 14 22:32:48 user nova-compute[76815]:   <name>instance-0000002a</name>
Nov 14 22:32:48 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:32:48 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:32:48 user nova-compute[76815]:   <metadata>
Nov 14 22:32:48 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:32:48 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:32:48 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1911769233</nova:name>
Nov 14 22:32:48 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:32:48</nova:creationTime>
Nov 14 22:32:48 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:32:48 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:32:48 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:32:48 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:32:48 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:32:48 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:32:48 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:32:48 user nova-compute[76815]:       <nova:owner>
Nov 14 22:32:48 user nova-compute[76815]:         <nova:user uuid="26aadea3a6964715be30b0fbb2c61c6b">tempest-AttachVolumeNegativeTest-716641985-project-member</nova:user>
Nov 14 22:32:48 user nova-compute[76815]:         <nova:project uuid="fd690e5ff8584e2f9e24597816d90b98">tempest-AttachVolumeNegativeTest-716641985</nova:project>
Nov 14 22:32:48 user nova-compute[76815]:       </nova:owner>
Nov 14 22:32:48 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:32:48 user nova-compute[76815]:       <nova:ports>
Nov 14 22:32:48 user nova-compute[76815]:         <nova:port uuid="9a148119-c074-4ba6-90f7-a7418ea8704f">
Nov 14 22:32:48 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 22:32:48 user nova-compute[76815]:         </nova:port>
Nov 14 22:32:48 user nova-compute[76815]:       </nova:ports>
Nov 14 22:32:48 user nova-compute[76815]:     </nova:instance>
Nov 14 22:32:48 user nova-compute[76815]:   </metadata>
Nov 14 22:32:48 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:32:48 user nova-compute[76815]:     <system>
Nov 14 22:32:48 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:32:48 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:32:48 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:32:48 user nova-compute[76815]:       <entry name="serial">aa018561-b7b2-464e-a340-07fb476a8685</entry>
Nov 14 22:32:48 user nova-compute[76815]:       <entry name="uuid">aa018561-b7b2-464e-a340-07fb476a8685</entry>
Nov 14 22:32:48 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:32:48 user nova-compute[76815]:     </system>
Nov 14 22:32:48 user nova-compute[76815]:   </sysinfo>
Nov 14 22:32:48 user nova-compute[76815]:   <os>
Nov 14 22:32:48 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:32:48 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:32:48 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:32:48 user nova-compute[76815]:   </os>
Nov 14 22:32:48 user nova-compute[76815]:   <features>
Nov 14 22:32:48 user nova-compute[76815]:     <acpi/>
Nov 14 22:32:48 user nova-compute[76815]:     <apic/>
Nov 14 22:32:48 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:32:48 user nova-compute[76815]:   </features>
Nov 14 22:32:48 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:32:48 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:32:48 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:32:48 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:32:48 user nova-compute[76815]:   </clock>
Nov 14 22:32:48 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:32:48 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:32:48 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:32:48 user nova-compute[76815]:   </cpu>
Nov 14 22:32:48 user nova-compute[76815]:   <devices>
Nov 14 22:32:48 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:32:48 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:32:48 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk"/>
Nov 14 22:32:48 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:32:48 user nova-compute[76815]:     </disk>
Nov 14 22:32:48 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:32:48 user nova-compute[76815]:       <mac address="fa:16:3e:87:f1:60"/>
Nov 14 22:32:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:32:48 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:32:48 user nova-compute[76815]:       <target dev="tap9a148119-c0"/>
Nov 14 22:32:48 user nova-compute[76815]:     </interface>
Nov 14 22:32:48 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:32:48 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/console.log" append="off"/>
Nov 14 22:32:48 user nova-compute[76815]:     </serial>
Nov 14 22:32:48 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:32:48 user nova-compute[76815]:     <video>
Nov 14 22:32:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:32:48 user nova-compute[76815]:     </video>
Nov 14 22:32:48 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:32:48 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:32:48 user nova-compute[76815]:     </rng>
Nov 14 22:32:48 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:32:48 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:32:48 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:32:48 user nova-compute[76815]:     </memballoon>
Nov 14 22:32:48 user nova-compute[76815]:   </devices>
Nov 14 22:32:48 user nova-compute[76815]: </domain>
Nov 14 22:32:48 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911769233',display_name='tempest-AttachVolumeNegativeTest-server-1911769233',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911769233',id=42,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJB5cClOz8WZK11zgeFVWVZQCn0Ngy13p8XIHbLbJatXSk8q2zKfvnAMzLQ2hhv7ox3DB3Sb1HKY4Mu0/GWpTurgqWOUrMZWqDsXkH2oT0gLPUjochOzen30+PSe0siuA==',key_name='tempest-keypair-1007656382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-jhcvmke3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:32:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=aa018561-b7b2-464e-a340-07fb476a8685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f1:60,bridge_name='br-int',has_traffic_filtering=True,id=9a148119-c074-4ba6-90f7-a7418ea8704f,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a148119-c0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG os_vif [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f1:60,bridge_name='br-int',has_traffic_filtering=True,id=9a148119-c074-4ba6-90f7-a7418ea8704f,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a148119-c0') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2487dae-16cd-5497-aac0-b66518dc6584', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a148119-c0, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a148119-c0, col_values=(('qos', UUID('5f9182f6-4bb2-4554-a9e5-332d610caa90')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a148119-c0, col_values=(('external_ids', {'iface-id': '9a148119-c074-4ba6-90f7-a7418ea8704f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f1:60', 'vm-uuid': 'aa018561-b7b2-464e-a340-07fb476a8685'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:48 user nova-compute[76815]: INFO os_vif [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f1:60,bridge_name='br-int',has_traffic_filtering=True,id=9a148119-c074-4ba6-90f7-a7418ea8704f,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a148119-c0')
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:32:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No VIF found with MAC fa:16:3e:87:f1:60, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:32:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-e0415a76-799f-43e7-af7b-ec037105dcb8 req-950361bc-c87e-44a3-82e5-75f1866f6faa service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received event network-vif-plugged-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e0415a76-799f-43e7-af7b-ec037105dcb8 req-950361bc-c87e-44a3-82e5-75f1866f6faa service nova] Acquiring lock "aa018561-b7b2-464e-a340-07fb476a8685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e0415a76-799f-43e7-af7b-ec037105dcb8 req-950361bc-c87e-44a3-82e5-75f1866f6faa service nova] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e0415a76-799f-43e7-af7b-ec037105dcb8 req-950361bc-c87e-44a3-82e5-75f1866f6faa service nova] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-e0415a76-799f-43e7-af7b-ec037105dcb8 req-950361bc-c87e-44a3-82e5-75f1866f6faa service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] No waiting events found dispatching network-vif-plugged-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:32:50 user nova-compute[76815]: WARNING nova.compute.manager [req-e0415a76-799f-43e7-af7b-ec037105dcb8 req-950361bc-c87e-44a3-82e5-75f1866f6faa service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received unexpected event network-vif-plugged-9a148119-c074-4ba6-90f7-a7418ea8704f for instance with vm_state building and task_state spawning.
Nov 14 22:32:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updating instance_info_cache with network_info: [{"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:32:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:32:52 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Instance spawned successfully.
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:32:52 user nova-compute[76815]: INFO nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-718d560f-e88b-49ae-a009-8b7404b70db3 req-4605ed83-a741-4ad5-bb63-836006be5385 service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received event network-vif-plugged-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-718d560f-e88b-49ae-a009-8b7404b70db3 req-4605ed83-a741-4ad5-bb63-836006be5385 service nova] Acquiring lock "aa018561-b7b2-464e-a340-07fb476a8685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-718d560f-e88b-49ae-a009-8b7404b70db3 req-4605ed83-a741-4ad5-bb63-836006be5385 service nova] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-718d560f-e88b-49ae-a009-8b7404b70db3 req-4605ed83-a741-4ad5-bb63-836006be5385 service nova] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-718d560f-e88b-49ae-a009-8b7404b70db3 req-4605ed83-a741-4ad5-bb63-836006be5385 service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] No waiting events found dispatching network-vif-plugged-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:32:52 user nova-compute[76815]: WARNING nova.compute.manager [req-718d560f-e88b-49ae-a009-8b7404b70db3 req-4605ed83-a741-4ad5-bb63-836006be5385 service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received unexpected event network-vif-plugged-9a148119-c074-4ba6-90f7-a7418ea8704f for instance with vm_state building and task_state spawning.
Nov 14 22:32:52 user nova-compute[76815]: INFO nova.compute.manager [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Took 6.34 seconds to build instance.
Nov 14 22:32:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c8d559ed-fceb-4882-9286-bf35df0452df tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "aa018561-b7b2-464e-a340-07fb476a8685" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.439s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:32:53 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:32:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:56 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:32:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:32:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:00 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:33:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "92a51373-b728-4a91-a503-a87740e84895" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:33:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:02 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:33:02 user nova-compute[76815]: INFO nova.compute.claims [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Claim successful on node user
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:33:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.policy [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7726302e74c45ba94acea58ff3ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06ff4e376e9419babeacd8a4d586574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:33:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Creating image(s)
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.192s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.192s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Successfully created port: cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk 1073741824" returned: 0 in 0.055s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:03 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:33:03 user nova-compute[76815]: INFO nova.compute.claims [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Claim successful on node user
Nov 14 22:33:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.217s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Cannot resize image /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Ensure instance console log exists: /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:33:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.policy [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7726302e74c45ba94acea58ff3ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06ff4e376e9419babeacd8a4d586574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Successfully updated port: cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquired lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:33:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Creating image(s)
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-4b8438ff-18e6-452a-a3d5-2621a12c8f83 req-3aa28bf9-3ca9-4aae-9c28-112a6b71bbab service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-changed-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-4b8438ff-18e6-452a-a3d5-2621a12c8f83 req-3aa28bf9-3ca9-4aae-9c28-112a6b71bbab service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Refreshing instance network info cache due to event network-changed-cc87e561-54f9-4667-9c88-0e0844042c51. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4b8438ff-18e6-452a-a3d5-2621a12c8f83 req-3aa28bf9-3ca9-4aae-9c28-112a6b71bbab service nova] Acquiring lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.193s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Releasing lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Instance network_info: |[{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4b8438ff-18e6-452a-a3d5-2621a12c8f83 req-3aa28bf9-3ca9-4aae-9c28-112a6b71bbab service nova] Acquired lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-4b8438ff-18e6-452a-a3d5-2621a12c8f83 req-3aa28bf9-3ca9-4aae-9c28-112a6b71bbab service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Refreshing network info cache for port cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Start _get_guest_xml network_info=[{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:33:04 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:33:04 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1645363141',display_name='tempest-ServerRescueNegativeTestJSON-server-1645363141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1645363141',id=43,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-fcbmz118',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:33:03Z,user_data=None,user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=92a51373-b728-4a91-a503-a87740e84895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=cc87e561-54f9-4667-9c88-0e0844042c51,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc87e561-54') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.objects.instance [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'pci_devices' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.215s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:33:04 user nova-compute[76815]:   <uuid>92a51373-b728-4a91-a503-a87740e84895</uuid>
Nov 14 22:33:04 user nova-compute[76815]:   <name>instance-0000002b</name>
Nov 14 22:33:04 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:33:04 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:33:04 user nova-compute[76815]:   <metadata>
Nov 14 22:33:04 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:33:04 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:33:04 user nova-compute[76815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1645363141</nova:name>
Nov 14 22:33:04 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:33:04</nova:creationTime>
Nov 14 22:33:04 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:33:04 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:33:04 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:33:04 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:33:04 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:33:04 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:33:04 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:33:04 user nova-compute[76815]:       <nova:owner>
Nov 14 22:33:04 user nova-compute[76815]:         <nova:user uuid="d7726302e74c45ba94acea58ff3ca7c6">tempest-ServerRescueNegativeTestJSON-1323022133-project-member</nova:user>
Nov 14 22:33:04 user nova-compute[76815]:         <nova:project uuid="b06ff4e376e9419babeacd8a4d586574">tempest-ServerRescueNegativeTestJSON-1323022133</nova:project>
Nov 14 22:33:04 user nova-compute[76815]:       </nova:owner>
Nov 14 22:33:04 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:33:04 user nova-compute[76815]:       <nova:ports>
Nov 14 22:33:04 user nova-compute[76815]:         <nova:port uuid="cc87e561-54f9-4667-9c88-0e0844042c51">
Nov 14 22:33:04 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 22:33:04 user nova-compute[76815]:         </nova:port>
Nov 14 22:33:04 user nova-compute[76815]:       </nova:ports>
Nov 14 22:33:04 user nova-compute[76815]:     </nova:instance>
Nov 14 22:33:04 user nova-compute[76815]:   </metadata>
Nov 14 22:33:04 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:33:04 user nova-compute[76815]:     <system>
Nov 14 22:33:04 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:33:04 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:33:04 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:33:04 user nova-compute[76815]:       <entry name="serial">92a51373-b728-4a91-a503-a87740e84895</entry>
Nov 14 22:33:04 user nova-compute[76815]:       <entry name="uuid">92a51373-b728-4a91-a503-a87740e84895</entry>
Nov 14 22:33:04 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:33:04 user nova-compute[76815]:     </system>
Nov 14 22:33:04 user nova-compute[76815]:   </sysinfo>
Nov 14 22:33:04 user nova-compute[76815]:   <os>
Nov 14 22:33:04 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:33:04 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:33:04 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:33:04 user nova-compute[76815]:   </os>
Nov 14 22:33:04 user nova-compute[76815]:   <features>
Nov 14 22:33:04 user nova-compute[76815]:     <acpi/>
Nov 14 22:33:04 user nova-compute[76815]:     <apic/>
Nov 14 22:33:04 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:33:04 user nova-compute[76815]:   </features>
Nov 14 22:33:04 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:33:04 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:33:04 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:33:04 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:33:04 user nova-compute[76815]:   </clock>
Nov 14 22:33:04 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:33:04 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:33:04 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:33:04 user nova-compute[76815]:   </cpu>
Nov 14 22:33:04 user nova-compute[76815]:   <devices>
Nov 14 22:33:04 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:33:04 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:33:04 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk"/>
Nov 14 22:33:04 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:33:04 user nova-compute[76815]:     </disk>
Nov 14 22:33:04 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:33:04 user nova-compute[76815]:       <mac address="fa:16:3e:ca:4f:31"/>
Nov 14 22:33:04 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:33:04 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:33:04 user nova-compute[76815]:       <target dev="tapcc87e561-54"/>
Nov 14 22:33:04 user nova-compute[76815]:     </interface>
Nov 14 22:33:04 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:33:04 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/console.log" append="off"/>
Nov 14 22:33:04 user nova-compute[76815]:     </serial>
Nov 14 22:33:04 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:33:04 user nova-compute[76815]:     <video>
Nov 14 22:33:04 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:33:04 user nova-compute[76815]:     </video>
Nov 14 22:33:04 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:33:04 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:33:04 user nova-compute[76815]:     </rng>
Nov 14 22:33:04 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:33:04 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:33:04 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:33:04 user nova-compute[76815]:     </memballoon>
Nov 14 22:33:04 user nova-compute[76815]:   </devices>
Nov 14 22:33:04 user nova-compute[76815]: </domain>
Nov 14 22:33:04 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1645363141',display_name='tempest-ServerRescueNegativeTestJSON-server-1645363141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1645363141',id=43,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-fcbmz118',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:33:03Z,user_data=None,user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=92a51373-b728-4a91-a503-a87740e84895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=cc87e561-54f9-4667-9c88-0e0844042c51,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc87e561-54') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG os_vif [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=cc87e561-54f9-4667-9c88-0e0844042c51,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc87e561-54') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk 1073741824" returned: 0 in 0.071s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '667aac9f-63da-52c2-bda0-354aaba45b8f', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Successfully created port: 0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc87e561-54, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc87e561-54, col_values=(('qos', UUID('a421d29d-26d2-4e52-9264-e7c83c98c5ee')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc87e561-54, col_values=(('external_ids', {'iface-id': 'cc87e561-54f9-4667-9c88-0e0844042c51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:4f:31', 'vm-uuid': '92a51373-b728-4a91-a503-a87740e84895'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:05 user nova-compute[76815]: INFO os_vif [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=cc87e561-54f9-4667-9c88-0e0844042c51,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc87e561-54')
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No VIF found with MAC fa:16:3e:ca:4f:31, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Cannot resize image /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Ensure instance console log exists: /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.network.neutron [req-4b8438ff-18e6-452a-a3d5-2621a12c8f83 req-3aa28bf9-3ca9-4aae-9c28-112a6b71bbab service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updated VIF entry in instance network info cache for port cc87e561-54f9-4667-9c88-0e0844042c51. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.network.neutron [req-4b8438ff-18e6-452a-a3d5-2621a12c8f83 req-3aa28bf9-3ca9-4aae-9c28-112a6b71bbab service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4b8438ff-18e6-452a-a3d5-2621a12c8f83 req-3aa28bf9-3ca9-4aae-9c28-112a6b71bbab service nova] Releasing lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Successfully updated port: 0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquired lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-28dc6b57-f3ac-4530-9506-f74d07018d34 req-9fde6300-a75c-4269-8de6-7486af01072d service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-changed-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-28dc6b57-f3ac-4530-9506-f74d07018d34 req-9fde6300-a75c-4269-8de6-7486af01072d service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Refreshing instance network info cache due to event network-changed-0471f42b-66c8-48c7-ba0a-f79ef88db9d5. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-28dc6b57-f3ac-4530-9506-f74d07018d34 req-9fde6300-a75c-4269-8de6-7486af01072d service nova] Acquiring lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updating instance_info_cache with network_info: [{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Releasing lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Instance network_info: |[{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-28dc6b57-f3ac-4530-9506-f74d07018d34 req-9fde6300-a75c-4269-8de6-7486af01072d service nova] Acquired lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.network.neutron [req-28dc6b57-f3ac-4530-9506-f74d07018d34 req-9fde6300-a75c-4269-8de6-7486af01072d service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Refreshing network info cache for port 0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Start _get_guest_xml network_info=[{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:33:05 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:33:05 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:33:05 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1987836517',display_name='tempest-ServerRescueNegativeTestJSON-server-1987836517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1987836517',id=44,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-j8ql9gl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:33:04Z,user_data=None,user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=038b8a86-c1ae-43c6-b5ac-d560babe8258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:55:f9,bridge_name='br-int',has_traffic_filtering=True,id=0471f42b-66c8-48c7-ba0a-f79ef88db9d5,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0471f42b-66') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.objects.instance [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'pci_devices' on Instance uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:33:06 user nova-compute[76815]:   <uuid>038b8a86-c1ae-43c6-b5ac-d560babe8258</uuid>
Nov 14 22:33:06 user nova-compute[76815]:   <name>instance-0000002c</name>
Nov 14 22:33:06 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:33:06 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:33:06 user nova-compute[76815]:   <metadata>
Nov 14 22:33:06 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:33:06 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:33:06 user nova-compute[76815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1987836517</nova:name>
Nov 14 22:33:06 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:33:05</nova:creationTime>
Nov 14 22:33:06 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:33:06 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:33:06 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:33:06 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:33:06 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:33:06 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:33:06 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:33:06 user nova-compute[76815]:       <nova:owner>
Nov 14 22:33:06 user nova-compute[76815]:         <nova:user uuid="d7726302e74c45ba94acea58ff3ca7c6">tempest-ServerRescueNegativeTestJSON-1323022133-project-member</nova:user>
Nov 14 22:33:06 user nova-compute[76815]:         <nova:project uuid="b06ff4e376e9419babeacd8a4d586574">tempest-ServerRescueNegativeTestJSON-1323022133</nova:project>
Nov 14 22:33:06 user nova-compute[76815]:       </nova:owner>
Nov 14 22:33:06 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:33:06 user nova-compute[76815]:       <nova:ports>
Nov 14 22:33:06 user nova-compute[76815]:         <nova:port uuid="0471f42b-66c8-48c7-ba0a-f79ef88db9d5">
Nov 14 22:33:06 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 22:33:06 user nova-compute[76815]:         </nova:port>
Nov 14 22:33:06 user nova-compute[76815]:       </nova:ports>
Nov 14 22:33:06 user nova-compute[76815]:     </nova:instance>
Nov 14 22:33:06 user nova-compute[76815]:   </metadata>
Nov 14 22:33:06 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:33:06 user nova-compute[76815]:     <system>
Nov 14 22:33:06 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:33:06 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:33:06 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:33:06 user nova-compute[76815]:       <entry name="serial">038b8a86-c1ae-43c6-b5ac-d560babe8258</entry>
Nov 14 22:33:06 user nova-compute[76815]:       <entry name="uuid">038b8a86-c1ae-43c6-b5ac-d560babe8258</entry>
Nov 14 22:33:06 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:33:06 user nova-compute[76815]:     </system>
Nov 14 22:33:06 user nova-compute[76815]:   </sysinfo>
Nov 14 22:33:06 user nova-compute[76815]:   <os>
Nov 14 22:33:06 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:33:06 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:33:06 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:33:06 user nova-compute[76815]:   </os>
Nov 14 22:33:06 user nova-compute[76815]:   <features>
Nov 14 22:33:06 user nova-compute[76815]:     <acpi/>
Nov 14 22:33:06 user nova-compute[76815]:     <apic/>
Nov 14 22:33:06 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:33:06 user nova-compute[76815]:   </features>
Nov 14 22:33:06 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:33:06 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:33:06 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:33:06 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:33:06 user nova-compute[76815]:   </clock>
Nov 14 22:33:06 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:33:06 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:33:06 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:33:06 user nova-compute[76815]:   </cpu>
Nov 14 22:33:06 user nova-compute[76815]:   <devices>
Nov 14 22:33:06 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:33:06 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:33:06 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk"/>
Nov 14 22:33:06 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:33:06 user nova-compute[76815]:     </disk>
Nov 14 22:33:06 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:33:06 user nova-compute[76815]:       <mac address="fa:16:3e:a7:55:f9"/>
Nov 14 22:33:06 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:33:06 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:33:06 user nova-compute[76815]:       <target dev="tap0471f42b-66"/>
Nov 14 22:33:06 user nova-compute[76815]:     </interface>
Nov 14 22:33:06 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:33:06 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/console.log" append="off"/>
Nov 14 22:33:06 user nova-compute[76815]:     </serial>
Nov 14 22:33:06 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:33:06 user nova-compute[76815]:     <video>
Nov 14 22:33:06 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:33:06 user nova-compute[76815]:     </video>
Nov 14 22:33:06 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:33:06 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:33:06 user nova-compute[76815]:     </rng>
Nov 14 22:33:06 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:33:06 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:33:06 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:33:06 user nova-compute[76815]:     </memballoon>
Nov 14 22:33:06 user nova-compute[76815]:   </devices>
Nov 14 22:33:06 user nova-compute[76815]: </domain>
Nov 14 22:33:06 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1987836517',display_name='tempest-ServerRescueNegativeTestJSON-server-1987836517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1987836517',id=44,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-j8ql9gl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:33:04Z,user_data=None,user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=038b8a86-c1ae-43c6-b5ac-d560babe8258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:55:f9,bridge_name='br-int',has_traffic_filtering=True,id=0471f42b-66c8-48c7-ba0a-f79ef88db9d5,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0471f42b-66') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG os_vif [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:55:f9,bridge_name='br-int',has_traffic_filtering=True,id=0471f42b-66c8-48c7-ba0a-f79ef88db9d5,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0471f42b-66') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '036540e9-0c90-5ee8-bfcb-d1174b5ef68d', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0471f42b-66, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0471f42b-66, col_values=(('qos', UUID('d147690d-1340-4501-be81-ba8599911d6d')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0471f42b-66, col_values=(('external_ids', {'iface-id': '0471f42b-66c8-48c7-ba0a-f79ef88db9d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:55:f9', 'vm-uuid': '038b8a86-c1ae-43c6-b5ac-d560babe8258'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: INFO os_vif [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:55:f9,bridge_name='br-int',has_traffic_filtering=True,id=0471f42b-66c8-48c7-ba0a-f79ef88db9d5,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0471f42b-66')
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No VIF found with MAC fa:16:3e:a7:55:f9, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-28dc6b57-f3ac-4530-9506-f74d07018d34 req-9fde6300-a75c-4269-8de6-7486af01072d service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updated VIF entry in instance network info cache for port 0471f42b-66c8-48c7-ba0a-f79ef88db9d5. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.network.neutron [req-28dc6b57-f3ac-4530-9506-f74d07018d34 req-9fde6300-a75c-4269-8de6-7486af01072d service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updating instance_info_cache with network_info: [{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-28dc6b57-f3ac-4530-9506-f74d07018d34 req-9fde6300-a75c-4269-8de6-7486af01072d service nova] Releasing lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-e7bf6501-cd4c-465c-8546-b679f3976cbb req-31ba60dd-5f9d-4c4d-ac7a-b82d68ae8e01 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e7bf6501-cd4c-465c-8546-b679f3976cbb req-31ba60dd-5f9d-4c4d-ac7a-b82d68ae8e01 service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e7bf6501-cd4c-465c-8546-b679f3976cbb req-31ba60dd-5f9d-4c4d-ac7a-b82d68ae8e01 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e7bf6501-cd4c-465c-8546-b679f3976cbb req-31ba60dd-5f9d-4c4d-ac7a-b82d68ae8e01 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-e7bf6501-cd4c-465c-8546-b679f3976cbb req-31ba60dd-5f9d-4c4d-ac7a-b82d68ae8e01 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:33:06 user nova-compute[76815]: WARNING nova.compute.manager [req-e7bf6501-cd4c-465c-8546-b679f3976cbb req-31ba60dd-5f9d-4c4d-ac7a-b82d68ae8e01 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state building and task_state spawning.
Nov 14 22:33:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-fea64ff3-6f11-4c4a-814e-c827c20e7861 req-6ddc7c92-2eae-47c3-8374-ff5c43239d71 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fea64ff3-6f11-4c4a-814e-c827c20e7861 req-6ddc7c92-2eae-47c3-8374-ff5c43239d71 service nova] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fea64ff3-6f11-4c4a-814e-c827c20e7861 req-6ddc7c92-2eae-47c3-8374-ff5c43239d71 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fea64ff3-6f11-4c4a-814e-c827c20e7861 req-6ddc7c92-2eae-47c3-8374-ff5c43239d71 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-fea64ff3-6f11-4c4a-814e-c827c20e7861 req-6ddc7c92-2eae-47c3-8374-ff5c43239d71 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] No waiting events found dispatching network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:33:08 user nova-compute[76815]: WARNING nova.compute.manager [req-fea64ff3-6f11-4c4a-814e-c827c20e7861 req-6ddc7c92-2eae-47c3-8374-ff5c43239d71 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received unexpected event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 for instance with vm_state building and task_state spawning.
Nov 14 22:33:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-93771544-f87c-48f8-8eee-0674138ab8d5 req-899ba8c1-478c-4ddc-ae7d-dcbdca8c172e service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-93771544-f87c-48f8-8eee-0674138ab8d5 req-899ba8c1-478c-4ddc-ae7d-dcbdca8c172e service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-93771544-f87c-48f8-8eee-0674138ab8d5 req-899ba8c1-478c-4ddc-ae7d-dcbdca8c172e service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-93771544-f87c-48f8-8eee-0674138ab8d5 req-899ba8c1-478c-4ddc-ae7d-dcbdca8c172e service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-93771544-f87c-48f8-8eee-0674138ab8d5 req-899ba8c1-478c-4ddc-ae7d-dcbdca8c172e service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:33:08 user nova-compute[76815]: WARNING nova.compute.manager [req-93771544-f87c-48f8-8eee-0674138ab8d5 req-899ba8c1-478c-4ddc-ae7d-dcbdca8c172e service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state building and task_state spawning.
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:33:09 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 92a51373-b728-4a91-a503-a87740e84895] Instance spawned successfully.
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:09 user nova-compute[76815]: INFO nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Took 6.46 seconds to spawn the instance on the hypervisor.
Nov 14 22:33:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:33:09 user nova-compute[76815]: INFO nova.compute.manager [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Took 7.01 seconds to build instance.
Nov 14 22:33:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7147c3c7-8668-46ea-9d04-a560d957d28a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "92a51373-b728-4a91-a503-a87740e84895" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.114s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:33:10 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Instance spawned successfully.
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:33:10 user nova-compute[76815]: INFO nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-0f6995ab-6f8c-4ce2-9549-a838b7f9e776 req-0d6441ca-6ba5-460f-b8b7-8d41b3a69024 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0f6995ab-6f8c-4ce2-9549-a838b7f9e776 req-0d6441ca-6ba5-460f-b8b7-8d41b3a69024 service nova] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0f6995ab-6f8c-4ce2-9549-a838b7f9e776 req-0d6441ca-6ba5-460f-b8b7-8d41b3a69024 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-0f6995ab-6f8c-4ce2-9549-a838b7f9e776 req-0d6441ca-6ba5-460f-b8b7-8d41b3a69024 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:10 user nova-compute[76815]: DEBUG nova.compute.manager [req-0f6995ab-6f8c-4ce2-9549-a838b7f9e776 req-0d6441ca-6ba5-460f-b8b7-8d41b3a69024 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] No waiting events found dispatching network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:33:10 user nova-compute[76815]: WARNING nova.compute.manager [req-0f6995ab-6f8c-4ce2-9549-a838b7f9e776 req-0d6441ca-6ba5-460f-b8b7-8d41b3a69024 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received unexpected event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 for instance with vm_state building and task_state spawning.
Nov 14 22:33:10 user nova-compute[76815]: INFO nova.compute.manager [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Took 6.61 seconds to build instance.
Nov 14 22:33:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ef8227db-8f54-4768-85dc-5d7d2cc371b6 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.742s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-61802161-1e1e-4c76-a264-53a458763240 req-b1bd2218-7ae9-4611-bc83-01ca6b971c62 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-changed-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:33:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-61802161-1e1e-4c76-a264-53a458763240 req-b1bd2218-7ae9-4611-bc83-01ca6b971c62 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Refreshing instance network info cache due to event network-changed-ecc05760-8b9f-47c6-aa52-6ada01978b59. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:33:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-61802161-1e1e-4c76-a264-53a458763240 req-b1bd2218-7ae9-4611-bc83-01ca6b971c62 service nova] Acquiring lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:33:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-61802161-1e1e-4c76-a264-53a458763240 req-b1bd2218-7ae9-4611-bc83-01ca6b971c62 service nova] Acquired lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:33:22 user nova-compute[76815]: DEBUG nova.network.neutron [req-61802161-1e1e-4c76-a264-53a458763240 req-b1bd2218-7ae9-4611-bc83-01ca6b971c62 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Refreshing network info cache for port ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:33:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:22 user nova-compute[76815]: DEBUG nova.network.neutron [req-61802161-1e1e-4c76-a264-53a458763240 req-b1bd2218-7ae9-4611-bc83-01ca6b971c62 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updated VIF entry in instance network info cache for port ecc05760-8b9f-47c6-aa52-6ada01978b59. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:33:22 user nova-compute[76815]: DEBUG nova.network.neutron [req-61802161-1e1e-4c76-a264-53a458763240 req-b1bd2218-7ae9-4611-bc83-01ca6b971c62 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updating instance_info_cache with network_info: [{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:33:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-61802161-1e1e-4c76-a264-53a458763240 req-b1bd2218-7ae9-4611-bc83-01ca6b971c62 service nova] Releasing lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG nova.objects.instance [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:24 user nova-compute[76815]: INFO nova.compute.manager [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Attaching volume 52a53a11-3c08-4a00-b147-7d708f6c8b83 to /dev/vdb
Nov 14 22:33:24 user nova-compute[76815]: DEBUG os_brick.utils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b38a17-9bdc-4806-bc41-82717aa9b4fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[115ca14a-7d76-4f69-b8d7-444c502ce137]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6910ba8-ba4a-4bdc-a783-f76840fa113e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3a65b9-e641-42ef-9d10-fc8184b638d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:33:24 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:33:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a204850c-4452-479d-87dc-5d957e36e3b1]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG os_brick.utils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:33:24 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updating existing volume attachment record: 86c5af8b-4f2f-4eff-b828-672d4e7dbadb {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:33:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flVIrYBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:33:29 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:33:29 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:33:29 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a470ab1-fd3c-4250-8e25-b06da56664b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:33:29 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b76cf27-28e8-42ae-8301-2fb7baf09d5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83] added
Nov 14 22:33:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2638e432-1850-44ab-95ed-68414203af15]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad2858e-005d-4c2c-bf5f-294cd017a3f6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flVIrYBD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flVIrYBD" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2614ccbf-9425-4442-af4a-a371da6ed911]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'flVIrYBD'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a379846-36a8-4d80-b841-2bb91f1c007b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[184fa447-bc0b-48d2-a3d7-b0aed3e4bc9e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:33:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:33:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[27268ea0-edbe-45bb-867e-a737aca22fc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260]
Nov 14 22:33:29 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260] successful.
Nov 14 22:33:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[061948b0-39f6-4d77-971b-51f7008771eb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e83b4db-d25f-4a6c-9fae-3e3684cb93f2]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:33:29 user nova-compute[76815]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:33:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:33:29 user nova-compute[76815]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:33:29 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaa5664-3c05-41a6-a896-e4e3c1e7736c]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:33:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flVIrYBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:33:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:33:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26436373762656461', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:33:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436373762656461', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:33:30 user nova-compute[76815]: DEBUG nova.objects.instance [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:33:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:33:30 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:33:30 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:33:30 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:33:30 user nova-compute[76815]:   <serial>52a53a11-3c08-4a00-b147-7d708f6c8b83</serial>
Nov 14 22:33:30 user nova-compute[76815]: </disk>
Nov 14 22:33:30 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:33:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:33:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:33:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No VIF found with MAC fa:16:3e:c4:49:e2, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:33:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6773abe-4a3d-4f85-ab1d-a38cbe737c02 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.839s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a3d8a9bd-6bf0-4ba5-8691-6a2828e26d6d tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a3d8a9bd-6bf0-4ba5-8691-6a2828e26d6d tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a3d8a9bd-6bf0-4ba5-8691-6a2828e26d6d tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a3d8a9bd-6bf0-4ba5-8691-6a2828e26d6d tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76815) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG nova.objects.instance [None req-a3d8a9bd-6bf0-4ba5-8691-6a2828e26d6d tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-b0dfee3a-056b-4ef2-9e20-8820278927e8 req-4e5551b4-6d3b-4bff-87f3-27a14daffd63 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-unplugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b0dfee3a-056b-4ef2-9e20-8820278927e8 req-4e5551b4-6d3b-4bff-87f3-27a14daffd63 service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b0dfee3a-056b-4ef2-9e20-8820278927e8 req-4e5551b4-6d3b-4bff-87f3-27a14daffd63 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b0dfee3a-056b-4ef2-9e20-8820278927e8 req-4e5551b4-6d3b-4bff-87f3-27a14daffd63 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:32 user nova-compute[76815]: DEBUG nova.compute.manager [req-b0dfee3a-056b-4ef2-9e20-8820278927e8 req-4e5551b4-6d3b-4bff-87f3-27a14daffd63 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-unplugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:33:32 user nova-compute[76815]: WARNING nova.compute.manager [req-b0dfee3a-056b-4ef2-9e20-8820278927e8 req-4e5551b4-6d3b-4bff-87f3-27a14daffd63 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-unplugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state active and task_state powering-off.
Nov 14 22:33:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance destroyed successfully.
Nov 14 22:33:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a3d8a9bd-6bf0-4ba5-8691-6a2828e26d6d tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:33:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a3d8a9bd-6bf0-4ba5-8691-6a2828e26d6d tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.988s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-ffa1cb7a-3963-4d57-a265-36cc8acece3c req-6e6a249a-53dd-48d8-b6a0-da4d00b3c62c service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:33:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ffa1cb7a-3963-4d57-a265-36cc8acece3c req-6e6a249a-53dd-48d8-b6a0-da4d00b3c62c service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ffa1cb7a-3963-4d57-a265-36cc8acece3c req-6e6a249a-53dd-48d8-b6a0-da4d00b3c62c service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ffa1cb7a-3963-4d57-a265-36cc8acece3c req-6e6a249a-53dd-48d8-b6a0-da4d00b3c62c service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-ffa1cb7a-3963-4d57-a265-36cc8acece3c req-6e6a249a-53dd-48d8-b6a0-da4d00b3c62c service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:33:34 user nova-compute[76815]: WARNING nova.compute.manager [req-ffa1cb7a-3963-4d57-a265-36cc8acece3c req-6e6a249a-53dd-48d8-b6a0-da4d00b3c62c service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state stopped and task_state None.
Nov 14 22:33:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:33:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:33:49 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:33:49 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=25.00188446044922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44223f88-c27a-4240-a6c8-754379a66a77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance aa018561-b7b2-464e-a340-07fb476a8685 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:33:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 44223f88-c27a-4240-a6c8-754379a66a77 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updating instance_info_cache with network_info: [{"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-44223f88-c27a-4240-a6c8-754379a66a77" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:33:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:33:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:33:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:33:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:33:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:33:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:00 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:34:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:34:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:34:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:34:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:09 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:34:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:34:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:34:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:34:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:34:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:34:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:34:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-880c6598-f212-456a-bd04-1e673bcda3d1 req-a5e69ed5-ea18-4962-ba02-731bab725463 service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received event network-changed-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-880c6598-f212-456a-bd04-1e673bcda3d1 req-a5e69ed5-ea18-4962-ba02-731bab725463 service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Refreshing instance network info cache due to event network-changed-9a148119-c074-4ba6-90f7-a7418ea8704f. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-880c6598-f212-456a-bd04-1e673bcda3d1 req-a5e69ed5-ea18-4962-ba02-731bab725463 service nova] Acquiring lock "refresh_cache-aa018561-b7b2-464e-a340-07fb476a8685" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-880c6598-f212-456a-bd04-1e673bcda3d1 req-a5e69ed5-ea18-4962-ba02-731bab725463 service nova] Acquired lock "refresh_cache-aa018561-b7b2-464e-a340-07fb476a8685" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG nova.network.neutron [req-880c6598-f212-456a-bd04-1e673bcda3d1 req-a5e69ed5-ea18-4962-ba02-731bab725463 service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Refreshing network info cache for port 9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "aa018561-b7b2-464e-a340-07fb476a8685" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "aa018561-b7b2-464e-a340-07fb476a8685" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "aa018561-b7b2-464e-a340-07fb476a8685-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:37 user nova-compute[76815]: INFO nova.compute.manager [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Terminating instance
Nov 14 22:34:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:34:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.network.neutron [req-880c6598-f212-456a-bd04-1e673bcda3d1 req-a5e69ed5-ea18-4962-ba02-731bab725463 service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Updated VIF entry in instance network info cache for port 9a148119-c074-4ba6-90f7-a7418ea8704f. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.network.neutron [req-880c6598-f212-456a-bd04-1e673bcda3d1 req-a5e69ed5-ea18-4962-ba02-731bab725463 service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Updating instance_info_cache with network_info: [{"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-880c6598-f212-456a-bd04-1e673bcda3d1 req-a5e69ed5-ea18-4962-ba02-731bab725463 service nova] Releasing lock "refresh_cache-aa018561-b7b2-464e-a340-07fb476a8685" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ee3c9917-10a8-4413-b939-4b9b470b664d req-b6a556f5-e69d-4f40-a8a6-4da65563b37d service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received event network-vif-unplugged-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ee3c9917-10a8-4413-b939-4b9b470b664d req-b6a556f5-e69d-4f40-a8a6-4da65563b37d service nova] Acquiring lock "aa018561-b7b2-464e-a340-07fb476a8685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ee3c9917-10a8-4413-b939-4b9b470b664d req-b6a556f5-e69d-4f40-a8a6-4da65563b37d service nova] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ee3c9917-10a8-4413-b939-4b9b470b664d req-b6a556f5-e69d-4f40-a8a6-4da65563b37d service nova] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ee3c9917-10a8-4413-b939-4b9b470b664d req-b6a556f5-e69d-4f40-a8a6-4da65563b37d service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] No waiting events found dispatching network-vif-unplugged-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-ee3c9917-10a8-4413-b939-4b9b470b664d req-b6a556f5-e69d-4f40-a8a6-4da65563b37d service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received event network-vif-unplugged-9a148119-c074-4ba6-90f7-a7418ea8704f for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Instance destroyed successfully.
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'resources' on Instance uuid aa018561-b7b2-464e-a340-07fb476a8685 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:32:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911769233',display_name='tempest-AttachVolumeNegativeTest-server-1911769233',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911769233',id=42,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJB5cClOz8WZK11zgeFVWVZQCn0Ngy13p8XIHbLbJatXSk8q2zKfvnAMzLQ2hhv7ox3DB3Sb1HKY4Mu0/GWpTurgqWOUrMZWqDsXkH2oT0gLPUjochOzen30+PSe0siuA==',key_name='tempest-keypair-1007656382',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:32:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-jhcvmke3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:32:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=aa018561-b7b2-464e-a340-07fb476a8685,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "9a148119-c074-4ba6-90f7-a7418ea8704f", "address": "fa:16:3e:87:f1:60", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a148119-c0", "ovs_interfaceid": "9a148119-c074-4ba6-90f7-a7418ea8704f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f1:60,bridge_name='br-int',has_traffic_filtering=True,id=9a148119-c074-4ba6-90f7-a7418ea8704f,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a148119-c0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG os_vif [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f1:60,bridge_name='br-int',has_traffic_filtering=True,id=9a148119-c074-4ba6-90f7-a7418ea8704f,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a148119-c0') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a148119-c0, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f9182f6-4bb2-4554-a9e5-332d610caa90) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:38 user nova-compute[76815]: INFO os_vif [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f1:60,bridge_name='br-int',has_traffic_filtering=True,id=9a148119-c074-4ba6-90f7-a7418ea8704f,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a148119-c0')
Nov 14 22:34:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Deleting instance files /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685_del
Nov 14 22:34:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Deletion of /opt/stack/data/nova/instances/aa018561-b7b2-464e-a340-07fb476a8685_del complete
Nov 14 22:34:38 user nova-compute[76815]: INFO nova.compute.manager [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 22:34:38 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:34:38 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: aa018561-b7b2-464e-a340-07fb476a8685] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:34:39 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:34:39 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Took 0.59 seconds to deallocate network for instance.
Nov 14 22:34:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:39 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:34:39 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:34:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-b5881f54-f9eb-42fe-8709-6caf572581cc req-371f7b86-a12b-42ed-9934-76760adba2de service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received event network-vif-deleted-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:34:39 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Deleted allocations for instance aa018561-b7b2-464e-a340-07fb476a8685
Nov 14 22:34:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2cdaa95b-b5e3-410c-9999-7bb2a4edbf05 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "aa018561-b7b2-464e-a340-07fb476a8685" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.849s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-22e734c6-3e0b-4544-a0cd-0a8407bb5083 req-7fa956be-b3f8-4920-b804-6c98f2704fee service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received event network-vif-plugged-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:34:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22e734c6-3e0b-4544-a0cd-0a8407bb5083 req-7fa956be-b3f8-4920-b804-6c98f2704fee service nova] Acquiring lock "aa018561-b7b2-464e-a340-07fb476a8685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22e734c6-3e0b-4544-a0cd-0a8407bb5083 req-7fa956be-b3f8-4920-b804-6c98f2704fee service nova] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22e734c6-3e0b-4544-a0cd-0a8407bb5083 req-7fa956be-b3f8-4920-b804-6c98f2704fee service nova] Lock "aa018561-b7b2-464e-a340-07fb476a8685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-22e734c6-3e0b-4544-a0cd-0a8407bb5083 req-7fa956be-b3f8-4920-b804-6c98f2704fee service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] No waiting events found dispatching network-vif-plugged-9a148119-c074-4ba6-90f7-a7418ea8704f {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:34:40 user nova-compute[76815]: WARNING nova.compute.manager [req-22e734c6-3e0b-4544-a0cd-0a8407bb5083 req-7fa956be-b3f8-4920-b804-6c98f2704fee service nova] [instance: aa018561-b7b2-464e-a340-07fb476a8685] Received unexpected event network-vif-plugged-9a148119-c074-4ba6-90f7-a7418ea8704f for instance with vm_state deleted and task_state None.
Nov 14 22:34:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_power_states {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 44223f88-c27a-4240-a6c8-754379a66a77 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "44223f88-c27a-4240-a6c8-754379a66a77" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "92a51373-b728-4a91-a503-a87740e84895" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "92a51373-b728-4a91-a503-a87740e84895" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "44223f88-c27a-4240-a6c8-754379a66a77" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:34:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:34:51 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:34:51 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=25.028217315673828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44223f88-c27a-4240-a6c8-754379a66a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:34:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:53 user nova-compute[76815]: INFO nova.compute.manager [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Rescuing
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquired lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG nova.network.neutron [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updating instance_info_cache with network_info: [{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:53 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG nova.network.neutron [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updating instance_info_cache with network_info: [{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Releasing lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-579d6959-8376-4a93-81f1-0a15bd0267ee req-d5d42024-db78-4c88-8c8c-68a44d0eb3f4 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-unplugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-579d6959-8376-4a93-81f1-0a15bd0267ee req-d5d42024-db78-4c88-8c8c-68a44d0eb3f4 service nova] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-579d6959-8376-4a93-81f1-0a15bd0267ee req-d5d42024-db78-4c88-8c8c-68a44d0eb3f4 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-579d6959-8376-4a93-81f1-0a15bd0267ee req-d5d42024-db78-4c88-8c8c-68a44d0eb3f4 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG nova.compute.manager [req-579d6959-8376-4a93-81f1-0a15bd0267ee req-d5d42024-db78-4c88-8c8c-68a44d0eb3f4 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] No waiting events found dispatching network-vif-unplugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:34:54 user nova-compute[76815]: WARNING nova.compute.manager [req-579d6959-8376-4a93-81f1-0a15bd0267ee req-d5d42024-db78-4c88-8c8c-68a44d0eb3f4 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received unexpected event network-vif-unplugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 for instance with vm_state active and task_state rescuing.
Nov 14 22:34:54 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Instance destroyed successfully.
Nov 14 22:34:54 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Attempting rescue
Nov 14 22:34:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Instance directory exists: not creating {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 22:34:54 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Creating image(s)
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'trusted_certs' on Instance uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue" returned: 0 in 0.060s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'migration_context' on Instance uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.base [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<038b8a86-c1ae-43c6-b5ac-d560babe8258> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Start _get_guest_xml network_info=[{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "vif_mac": "fa:16:3e:a7:55:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'resources' on Instance uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.base [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<038b8a86-c1ae-43c6-b5ac-d560babe8258> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'numa_topology' on Instance uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.base [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<038b8a86-c1ae-43c6-b5ac-d560babe8258> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:34:55 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:34:55 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'vcpu_model' on Instance uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.base [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<038b8a86-c1ae-43c6-b5ac-d560babe8258> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1987836517',display_name='tempest-ServerRescueNegativeTestJSON-server-1987836517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1987836517',id=44,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-j8ql9gl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:33:10Z,user_data=None,user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=038b8a86-c1ae-43c6-b5ac-d560babe8258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "vif_mac": "fa:16:3e:a7:55:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "vif_mac": "fa:16:3e:a7:55:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:55:f9,bridge_name='br-int',has_traffic_filtering=True,id=0471f42b-66c8-48c7-ba0a-f79ef88db9d5,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0471f42b-66') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'pci_devices' on Instance uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.objects.base [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<038b8a86-c1ae-43c6-b5ac-d560babe8258> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:34:55 user nova-compute[76815]:   <uuid>038b8a86-c1ae-43c6-b5ac-d560babe8258</uuid>
Nov 14 22:34:55 user nova-compute[76815]:   <name>instance-0000002c</name>
Nov 14 22:34:55 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:34:55 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:34:55 user nova-compute[76815]:   <metadata>
Nov 14 22:34:55 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:34:55 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:34:55 user nova-compute[76815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1987836517</nova:name>
Nov 14 22:34:55 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:34:55</nova:creationTime>
Nov 14 22:34:55 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:34:55 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:34:55 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:34:55 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:34:55 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:34:55 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:34:55 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:34:55 user nova-compute[76815]:       <nova:owner>
Nov 14 22:34:55 user nova-compute[76815]:         <nova:user uuid="d7726302e74c45ba94acea58ff3ca7c6">tempest-ServerRescueNegativeTestJSON-1323022133-project-member</nova:user>
Nov 14 22:34:55 user nova-compute[76815]:         <nova:project uuid="b06ff4e376e9419babeacd8a4d586574">tempest-ServerRescueNegativeTestJSON-1323022133</nova:project>
Nov 14 22:34:55 user nova-compute[76815]:       </nova:owner>
Nov 14 22:34:55 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:34:55 user nova-compute[76815]:       <nova:ports>
Nov 14 22:34:55 user nova-compute[76815]:         <nova:port uuid="0471f42b-66c8-48c7-ba0a-f79ef88db9d5">
Nov 14 22:34:55 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 22:34:55 user nova-compute[76815]:         </nova:port>
Nov 14 22:34:55 user nova-compute[76815]:       </nova:ports>
Nov 14 22:34:55 user nova-compute[76815]:     </nova:instance>
Nov 14 22:34:55 user nova-compute[76815]:   </metadata>
Nov 14 22:34:55 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:34:55 user nova-compute[76815]:     <system>
Nov 14 22:34:55 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:34:55 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:34:55 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:34:55 user nova-compute[76815]:       <entry name="serial">038b8a86-c1ae-43c6-b5ac-d560babe8258</entry>
Nov 14 22:34:55 user nova-compute[76815]:       <entry name="uuid">038b8a86-c1ae-43c6-b5ac-d560babe8258</entry>
Nov 14 22:34:55 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:34:55 user nova-compute[76815]:     </system>
Nov 14 22:34:55 user nova-compute[76815]:   </sysinfo>
Nov 14 22:34:55 user nova-compute[76815]:   <os>
Nov 14 22:34:55 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:34:55 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:34:55 user nova-compute[76815]:   </os>
Nov 14 22:34:55 user nova-compute[76815]:   <features>
Nov 14 22:34:55 user nova-compute[76815]:     <acpi/>
Nov 14 22:34:55 user nova-compute[76815]:     <apic/>
Nov 14 22:34:55 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:34:55 user nova-compute[76815]:   </features>
Nov 14 22:34:55 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:34:55 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:34:55 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:34:55 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:34:55 user nova-compute[76815]:   </clock>
Nov 14 22:34:55 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:34:55 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:34:55 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:34:55 user nova-compute[76815]:   </cpu>
Nov 14 22:34:55 user nova-compute[76815]:   <devices>
Nov 14 22:34:55 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:34:55 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:34:55 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue"/>
Nov 14 22:34:55 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:34:55 user nova-compute[76815]:     </disk>
Nov 14 22:34:55 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:34:55 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:34:55 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk"/>
Nov 14 22:34:55 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:34:55 user nova-compute[76815]:     </disk>
Nov 14 22:34:55 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:34:55 user nova-compute[76815]:       <mac address="fa:16:3e:a7:55:f9"/>
Nov 14 22:34:55 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:34:55 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:34:55 user nova-compute[76815]:       <target dev="tap0471f42b-66"/>
Nov 14 22:34:55 user nova-compute[76815]:     </interface>
Nov 14 22:34:55 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:34:55 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/console.log" append="off"/>
Nov 14 22:34:55 user nova-compute[76815]:     </serial>
Nov 14 22:34:55 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:34:55 user nova-compute[76815]:     <video>
Nov 14 22:34:55 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:34:55 user nova-compute[76815]:     </video>
Nov 14 22:34:55 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:34:55 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:34:55 user nova-compute[76815]:     </rng>
Nov 14 22:34:55 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:34:55 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:34:55 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:34:55 user nova-compute[76815]:     </memballoon>
Nov 14 22:34:55 user nova-compute[76815]:   </devices>
Nov 14 22:34:55 user nova-compute[76815]: </domain>
Nov 14 22:34:55 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:34:55 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Instance destroyed successfully.
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:34:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No VIF found with MAC fa:16:3e:a7:55:f9, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:34:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-a87e8aa3-2b95-4fdf-8243-54fb93dff85a req-5de20348-916a-4fb1-8e5b-604072970f29 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:34:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a87e8aa3-2b95-4fdf-8243-54fb93dff85a req-5de20348-916a-4fb1-8e5b-604072970f29 service nova] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a87e8aa3-2b95-4fdf-8243-54fb93dff85a req-5de20348-916a-4fb1-8e5b-604072970f29 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a87e8aa3-2b95-4fdf-8243-54fb93dff85a req-5de20348-916a-4fb1-8e5b-604072970f29 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-a87e8aa3-2b95-4fdf-8243-54fb93dff85a req-5de20348-916a-4fb1-8e5b-604072970f29 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] No waiting events found dispatching network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:34:56 user nova-compute[76815]: WARNING nova.compute.manager [req-a87e8aa3-2b95-4fdf-8243-54fb93dff85a req-5de20348-916a-4fb1-8e5b-604072970f29 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received unexpected event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 for instance with vm_state active and task_state rescuing.
Nov 14 22:34:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:57 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:34:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-3177246d-a41f-42e0-bebf-35dd6984322a tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] No waiting events found dispatching network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:34:58 user nova-compute[76815]: WARNING nova.compute.manager [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received unexpected event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 for instance with vm_state active and task_state rescuing.
Nov 14 22:34:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:34:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] No waiting events found dispatching network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:34:58 user nova-compute[76815]: WARNING nova.compute.manager [req-cfd0a87d-dcc6-401c-a1a6-b81e01d53abc req-25d62b6b-a8a3-4916-872e-ace57aa876b9 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received unexpected event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 for instance with vm_state active and task_state rescuing.
Nov 14 22:34:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:34:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:35:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:35:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:35:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:35:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:35:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:35:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:35:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:35:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquired lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:35:23 user nova-compute[76815]: DEBUG nova.network.neutron [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:35:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'info_cache' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:35:23 user nova-compute[76815]: DEBUG nova.objects.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:35:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.network.neutron [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updating instance_info_cache with network_info: [{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Releasing lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:35:24 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance destroyed successfully.
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.objects.instance [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'resources' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.objects.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-88532880',display_name='tempest-AttachVolumeTestJSON-server-88532880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-88532880',id=41,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQubaL4MRQuzJoCVwamFoNIlvVZWcGCwACqD1aiy1LaEn8qAs7tkZ5TTctrQdfL2x8ZstSYKMLnmOAaQmEsNBAZvuRmZsqzswxqjPsbJlZXq1ikUWRFm/k6lX6ZPoGyzg==',key_name='tempest-keypair-2014797013',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-436ixbo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:33:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=4726306c-2d1d-4395-af5c-bcb631d47e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_vif [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecc05760-8b, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5501186-9467-418a-8623-c3587f7a10ca) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:35:24 user nova-compute[76815]: INFO os_vif [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b')
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flVIrYBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:35:24 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b02b5-c73b-4949-aa5c-f439d21c7e6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:35:24 user nova-compute[76815]: No targets found.
Nov 14 22:35:24 user nova-compute[76815]: iSNS:
Nov 14 22:35:24 user nova-compute[76815]: No targets found.
Nov 14 22:35:24 user nova-compute[76815]: STATIC:
Nov 14 22:35:24 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78
Nov 14 22:35:24 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:35:24 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:35:24 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83
Nov 14 22:35:24 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:35:24 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:35:24 user nova-compute[76815]: FIRMWARE:
Nov 14 22:35:24 user nova-compute[76815]: No targets found.
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:35:24 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:35:24 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[318857c4-53d4-4cc1-9bcf-09c4879e8a0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c0cf9f-07a1-4724-ac97-275fde2c4746]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4793be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a3491c-3334-4d29-bc02-b35ef2378a26]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f4d854-bf3c-4759-a030-cae0738e4aa3]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2c1dae-e93e-4223-8327-e28298b6c12a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b32d2f-1339-42d9-a0f5-66861dabead7]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85783e17-9985-46ea-90bc-99f68920414e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[802ceec6-13cf-4334-a607-b0fbaba590fe]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260]
Nov 14 22:35:24 user nova-compute[76815]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260] successful.
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b4a9a5-0449-44fe-8be1-fdbf488f7d47]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== disconnect_volume: return (304ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Start _get_guest_xml network_info=[{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flVIrYBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4726306c-2d1d-4395-af5c-bcb631d47e3a', 'attached_at': '', 'detached_at': '', 'volume_id': '52a53a11-3c08-4a00-b147-7d708f6c8b83', 'serial': '52a53a11-3c08-4a00-b147-7d708f6c8b83'}, 'attachment_id': '86c5af8b-4f2f-4eff-b828-672d4e7dbadb', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.objects.instance [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'numa_topology' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.objects.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:35:24 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:35:24 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.objects.instance [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.objects.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flVIrYBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:35:24 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:35:24 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:35:24 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e668d1-7308-4fd1-a3b2-2f2f80631972]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:35:24 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7799e396-7d67-40e4-be1a-78fc6b5ec434]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83] added
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5568b879-9b21-40d8-a946-0b418efe601e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[082c54ea-6c92-4cd5-9075-00d80b25f4df]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flVIrYBD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v flVIrYBD" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a30f83-f6b6-4283-9aa2-5c952fb12746]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'flVIrYBD'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[388b25c0-7f09-4785-a077-f5ef202d3652]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3cde24-1398-4d5e-98d2-2603216b6e28]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05fc0f8-1a21-45c1-a338-7b862df77e5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260]
Nov 14 22:35:24 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260] successful.
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67565a9d-4f38-4ae7-bce8-aa0d3999e614]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac83426e-bb19-43d1-a487-a32c91fd725c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:35:24 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547dc5e-30b0-48b2-8247-d8aa79405658]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:35:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flVIrYBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26436373762656461', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436373762656461', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-88532880',display_name='tempest-AttachVolumeTestJSON-server-88532880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-88532880',id=41,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQubaL4MRQuzJoCVwamFoNIlvVZWcGCwACqD1aiy1LaEn8qAs7tkZ5TTctrQdfL2x8ZstSYKMLnmOAaQmEsNBAZvuRmZsqzswxqjPsbJlZXq1ikUWRFm/k6lX6ZPoGyzg==',key_name='tempest-keypair-2014797013',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-436ixbo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:33:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=4726306c-2d1d-4395-af5c-bcb631d47e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG nova.objects.instance [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'pci_devices' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG nova.objects.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:35:25 user nova-compute[76815]:   <uuid>4726306c-2d1d-4395-af5c-bcb631d47e3a</uuid>
Nov 14 22:35:25 user nova-compute[76815]:   <name>instance-00000029</name>
Nov 14 22:35:25 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:35:25 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:35:25 user nova-compute[76815]:   <metadata>
Nov 14 22:35:25 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:35:25 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:35:25 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeTestJSON-server-88532880</nova:name>
Nov 14 22:35:25 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:35:24</nova:creationTime>
Nov 14 22:35:25 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:35:25 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:35:25 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:35:25 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:35:25 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:35:25 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:35:25 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:35:25 user nova-compute[76815]:       <nova:owner>
Nov 14 22:35:25 user nova-compute[76815]:         <nova:user uuid="3590183279e742f0bced96008d784cfb">tempest-AttachVolumeTestJSON-252609817-project-member</nova:user>
Nov 14 22:35:25 user nova-compute[76815]:         <nova:project uuid="e13ac882a01d4abfa130458292b5cd40">tempest-AttachVolumeTestJSON-252609817</nova:project>
Nov 14 22:35:25 user nova-compute[76815]:       </nova:owner>
Nov 14 22:35:25 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:35:25 user nova-compute[76815]:       <nova:ports>
Nov 14 22:35:25 user nova-compute[76815]:         <nova:port uuid="ecc05760-8b9f-47c6-aa52-6ada01978b59">
Nov 14 22:35:25 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:35:25 user nova-compute[76815]:         </nova:port>
Nov 14 22:35:25 user nova-compute[76815]:       </nova:ports>
Nov 14 22:35:25 user nova-compute[76815]:     </nova:instance>
Nov 14 22:35:25 user nova-compute[76815]:   </metadata>
Nov 14 22:35:25 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:35:25 user nova-compute[76815]:     <system>
Nov 14 22:35:25 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:35:25 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:35:25 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:35:25 user nova-compute[76815]:       <entry name="serial">4726306c-2d1d-4395-af5c-bcb631d47e3a</entry>
Nov 14 22:35:25 user nova-compute[76815]:       <entry name="uuid">4726306c-2d1d-4395-af5c-bcb631d47e3a</entry>
Nov 14 22:35:25 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:35:25 user nova-compute[76815]:     </system>
Nov 14 22:35:25 user nova-compute[76815]:   </sysinfo>
Nov 14 22:35:25 user nova-compute[76815]:   <os>
Nov 14 22:35:25 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:35:25 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:35:25 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:35:25 user nova-compute[76815]:   </os>
Nov 14 22:35:25 user nova-compute[76815]:   <features>
Nov 14 22:35:25 user nova-compute[76815]:     <acpi/>
Nov 14 22:35:25 user nova-compute[76815]:     <apic/>
Nov 14 22:35:25 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:35:25 user nova-compute[76815]:   </features>
Nov 14 22:35:25 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:35:25 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:35:25 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:35:25 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:35:25 user nova-compute[76815]:   </clock>
Nov 14 22:35:25 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:35:25 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:35:25 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:35:25 user nova-compute[76815]:   </cpu>
Nov 14 22:35:25 user nova-compute[76815]:   <devices>
Nov 14 22:35:25 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:35:25 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:35:25 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk"/>
Nov 14 22:35:25 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:35:25 user nova-compute[76815]:     </disk>
Nov 14 22:35:25 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:35:25 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:35:25 user nova-compute[76815]:       <source dev="/dev/sdc"/>
Nov 14 22:35:25 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:35:25 user nova-compute[76815]:       <serial>52a53a11-3c08-4a00-b147-7d708f6c8b83</serial>
Nov 14 22:35:25 user nova-compute[76815]:     </disk>
Nov 14 22:35:25 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:35:25 user nova-compute[76815]:       <mac address="fa:16:3e:c4:49:e2"/>
Nov 14 22:35:25 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:35:25 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:35:25 user nova-compute[76815]:       <target dev="tapecc05760-8b"/>
Nov 14 22:35:25 user nova-compute[76815]:     </interface>
Nov 14 22:35:25 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:35:25 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/console.log" append="off"/>
Nov 14 22:35:25 user nova-compute[76815]:     </serial>
Nov 14 22:35:25 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:35:25 user nova-compute[76815]:     <video>
Nov 14 22:35:25 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:35:25 user nova-compute[76815]:     </video>
Nov 14 22:35:25 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:35:25 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:35:25 user nova-compute[76815]:     </rng>
Nov 14 22:35:25 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:35:25 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:35:25 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:35:25 user nova-compute[76815]:     </memballoon>
Nov 14 22:35:25 user nova-compute[76815]:   </devices>
Nov 14 22:35:25 user nova-compute[76815]: </domain>
Nov 14 22:35:25 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:35:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.objects.instance [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.objects.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Cannot resize image /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.objects.instance [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'migration_context' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.objects.base [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-88532880',display_name='tempest-AttachVolumeTestJSON-server-88532880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-88532880',id=41,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQubaL4MRQuzJoCVwamFoNIlvVZWcGCwACqD1aiy1LaEn8qAs7tkZ5TTctrQdfL2x8ZstSYKMLnmOAaQmEsNBAZvuRmZsqzswxqjPsbJlZXq1ikUWRFm/k6lX6ZPoGyzg==',key_name='tempest-keypair-2014797013',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-436ixbo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:33:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=4726306c-2d1d-4395-af5c-bcb631d47e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG os_vif [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd63c7f9d-8750-5959-902c-5a9bfc124e22', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecc05760-8b, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecc05760-8b, col_values=(('qos', UUID('6e0278f2-1969-4646-8124-510c93568d44')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecc05760-8b, col_values=(('external_ids', {'iface-id': 'ecc05760-8b9f-47c6-aa52-6ada01978b59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:49:e2', 'vm-uuid': '4726306c-2d1d-4395-af5c-bcb631d47e3a'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:35:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:26 user nova-compute[76815]: INFO os_vif [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b')
Nov 14 22:35:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-5eafd4f9-ada6-4f40-9d08-12a9a4117113 req-a56e4cc6-6d3b-43d5-ae16-6f22b6de38b9 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:35:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eafd4f9-ada6-4f40-9d08-12a9a4117113 req-a56e4cc6-6d3b-43d5-ae16-6f22b6de38b9 service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:35:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eafd4f9-ada6-4f40-9d08-12a9a4117113 req-a56e4cc6-6d3b-43d5-ae16-6f22b6de38b9 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:35:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5eafd4f9-ada6-4f40-9d08-12a9a4117113 req-a56e4cc6-6d3b-43d5-ae16-6f22b6de38b9 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:35:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-5eafd4f9-ada6-4f40-9d08-12a9a4117113 req-a56e4cc6-6d3b-43d5-ae16-6f22b6de38b9 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:35:28 user nova-compute[76815]: WARNING nova.compute.manager [req-5eafd4f9-ada6-4f40-9d08-12a9a4117113 req-a56e4cc6-6d3b-43d5-ae16-6f22b6de38b9 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state stopped and task_state powering-on.
Nov 14 22:35:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:35:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:35:29 user nova-compute[76815]: INFO nova.compute.manager [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Detaching volume 3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78
Nov 14 22:35:29 user nova-compute[76815]: INFO nova.virt.block_device [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Attempting to driver detach volume 3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 from mountpoint /dev/vdb
Nov 14 22:35:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Attempting to detach device vdb from instance 44223f88-c27a-4240-a6c8-754379a66a77 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:35:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:35:29 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:35:29 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:35:29 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:35:29 user nova-compute[76815]:   <serial>3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78</serial>
Nov 14 22:35:29 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:35:29 user nova-compute[76815]: </disk>
Nov 14 22:35:29 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:35:29 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully detached device vdb from instance 44223f88-c27a-4240-a6c8-754379a66a77 from the persistent domain config.
Nov 14 22:35:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44223f88-c27a-4240-a6c8-754379a66a77 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:35:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:35:29 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:35:29 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:35:29 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:35:29 user nova-compute[76815]:   <serial>3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78</serial>
Nov 14 22:35:29 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:35:29 user nova-compute[76815]: </disk>
Nov 14 22:35:29 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:35:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44223f88-c27a-4240-a6c8-754379a66a77 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:35:30 user nova-compute[76815]: DEBUG nova.compute.manager [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:35:30 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance rebooted successfully.
Nov 14 22:35:30 user nova-compute[76815]: DEBUG nova.compute.manager [None req-818662d7-9a45-4784-be83-c2ae330f4abc tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:35:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-bd86fba0-702c-468f-9a0b-f7f5ea9c59da req-d4031fc4-7c5b-4fae-b47c-d895db1a1d8f service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:35:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bd86fba0-702c-468f-9a0b-f7f5ea9c59da req-d4031fc4-7c5b-4fae-b47c-d895db1a1d8f service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:35:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bd86fba0-702c-468f-9a0b-f7f5ea9c59da req-d4031fc4-7c5b-4fae-b47c-d895db1a1d8f service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:35:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-bd86fba0-702c-468f-9a0b-f7f5ea9c59da req-d4031fc4-7c5b-4fae-b47c-d895db1a1d8f service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:35:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-bd86fba0-702c-468f-9a0b-f7f5ea9c59da req-d4031fc4-7c5b-4fae-b47c-d895db1a1d8f service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:35:30 user nova-compute[76815]: WARNING nova.compute.manager [req-bd86fba0-702c-468f-9a0b-f7f5ea9c59da req-d4031fc4-7c5b-4fae-b47c-d895db1a1d8f service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state stopped and task_state powering-on.
Nov 14 22:35:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:35:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:35:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:35:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:35:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:35:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:35:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:49 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 44223f88-c27a-4240-a6c8-754379a66a77 is timed out.
Nov 14 22:35:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully detached device vdb from instance 44223f88-c27a-4240-a6c8-754379a66a77 from the live domain config.
Nov 14 22:35:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xepoilHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:35:49 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4c8bab-e809-4097-8c66-b5825e9152d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:35:49 user nova-compute[76815]: No targets found.
Nov 14 22:35:49 user nova-compute[76815]: iSNS:
Nov 14 22:35:49 user nova-compute[76815]: No targets found.
Nov 14 22:35:49 user nova-compute[76815]: STATIC:
Nov 14 22:35:49 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78
Nov 14 22:35:49 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:35:49 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:35:49 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83
Nov 14 22:35:49 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:35:49 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:35:49 user nova-compute[76815]: FIRMWARE:
Nov 14 22:35:49 user nova-compute[76815]: No targets found.
Nov 14 22:35:49 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:35:49 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:35:49 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[723982c8-2840-4a0c-afb4-70bb0f4bd6ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee41fa-bde1-484b-a72d-502e4797ec11]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:35:49 user nova-compute[76815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:35:49 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 (non-flash)
Nov 14 22:35:49 user nova-compute[76815]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:35:49 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c82c6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e1ab86-2f42-423c-802f-30b530a73848]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad96001-87ad-4502-a1ae-c7730c1ffb0b]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b63f019-8adb-4856-9244-3913ebe508bb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[91443586-e09a-432f-b052-05c1aa46a45b]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8237dfae-b938-42b3-82d1-769b0891f553]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9a47da-f162-4540-a199-b5f886c110d7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78, portal: 172.16.0.220,3260]
Nov 14 22:35:49 user nova-compute[76815]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78, portal: 172.16.0.220,3260] successful.
Nov 14 22:35:49 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ded73c2-7b11-4b9f-abf4-44ed7a5b3f78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc18bf2-c4f5-4e5e-8f16-734c2a741699]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] <== disconnect_volume: return (288ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:35:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG nova.objects.instance [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'flavor' on Instance uuid 44223f88-c27a-4240-a6c8-754379a66a77 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c9f299e8-9820-4f9a-a558-4b66c6095eb7 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.835s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:35:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:35:52 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:35:52 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8556MB free_disk=25.017684936523438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44223f88-c27a-4240-a6c8-754379a66a77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:35:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:54 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:35:54 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:35:54 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:35:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:35:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:35:54 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:35:55 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:35:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:35:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:35:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:35:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:35:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:35:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:35:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:35:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:00 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:36:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:36:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:36:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:36:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:36:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:36:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:36:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:36:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:36:19 user nova-compute[76815]: INFO nova.compute.manager [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Terminating instance
Nov 14 22:36:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-2f82719b-528d-450a-adac-865ebe4afcc3 req-ac8187f1-dcc2-4b7e-89ef-f088ca8e80e4 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received event network-vif-unplugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2f82719b-528d-450a-adac-865ebe4afcc3 req-ac8187f1-dcc2-4b7e-89ef-f088ca8e80e4 service nova] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2f82719b-528d-450a-adac-865ebe4afcc3 req-ac8187f1-dcc2-4b7e-89ef-f088ca8e80e4 service nova] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2f82719b-528d-450a-adac-865ebe4afcc3 req-ac8187f1-dcc2-4b7e-89ef-f088ca8e80e4 service nova] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-2f82719b-528d-450a-adac-865ebe4afcc3 req-ac8187f1-dcc2-4b7e-89ef-f088ca8e80e4 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] No waiting events found dispatching network-vif-unplugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:36:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-2f82719b-528d-450a-adac-865ebe4afcc3 req-ac8187f1-dcc2-4b7e-89ef-f088ca8e80e4 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received event network-vif-unplugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:36:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Instance destroyed successfully.
Nov 14 22:36:20 user nova-compute[76815]: DEBUG nova.objects.instance [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'resources' on Instance uuid 44223f88-c27a-4240-a6c8-754379a66a77 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1082839487',display_name='tempest-AttachVolumeNegativeTest-server-1082839487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1082839487',id=40,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBX8klxfdjehzUiftqFuwbVM3fASnjnRN7OPqNuKNCdTbw5uKP6H8vAdBjeDUU+uLjUNwEyvwRlB6E5h/CwTBp30TkCXkt0MltTqwoLzVtWoe7c7Q9iypHo6y6zpGpOcNw==',key_name='tempest-keypair-470330138',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:30:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-2qwj0wlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:30:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=44223f88-c27a-4240-a6c8-754379a66a77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "address": "fa:16:3e:a7:e5:fb", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ddc3be6-38", "ovs_interfaceid": "6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e5:fb,bridge_name='br-int',has_traffic_filtering=True,id=6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddc3be6-38') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG os_vif [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e5:fb,bridge_name='br-int',has_traffic_filtering=True,id=6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddc3be6-38') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ddc3be6-38, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0eda05f3-bf4c-4464-9ae1-52c8239d0323) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:36:20 user nova-compute[76815]: INFO os_vif [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e5:fb,bridge_name='br-int',has_traffic_filtering=True,id=6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ddc3be6-38')
Nov 14 22:36:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Deleting instance files /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77_del
Nov 14 22:36:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Deletion of /opt/stack/data/nova/instances/44223f88-c27a-4240-a6c8-754379a66a77_del complete
Nov 14 22:36:20 user nova-compute[76815]: INFO nova.compute.manager [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 22:36:20 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:36:20 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:36:21 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Took 0.85 seconds to deallocate network for instance.
Nov 14 22:36:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-d7b2e269-7f8a-4395-8740-4717774e20af req-4c913a05-6cc6-4122-ac76-a916b1a8c5c5 service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received event network-vif-deleted-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:36:21 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Deleted allocations for instance 44223f88-c27a-4240-a6c8-754379a66a77
Nov 14 22:36:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-10f66823-ae58-4a0b-9b1e-befa2b680d23 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "44223f88-c27a-4240-a6c8-754379a66a77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-03e68483-49a1-4add-b980-a6639172705a req-f4a84d2c-b87e-47a2-9968-53efbbfcec0d service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received event network-vif-plugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-03e68483-49a1-4add-b980-a6639172705a req-f4a84d2c-b87e-47a2-9968-53efbbfcec0d service nova] Acquiring lock "44223f88-c27a-4240-a6c8-754379a66a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-03e68483-49a1-4add-b980-a6639172705a req-f4a84d2c-b87e-47a2-9968-53efbbfcec0d service nova] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-03e68483-49a1-4add-b980-a6639172705a req-f4a84d2c-b87e-47a2-9968-53efbbfcec0d service nova] Lock "44223f88-c27a-4240-a6c8-754379a66a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:36:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-03e68483-49a1-4add-b980-a6639172705a req-f4a84d2c-b87e-47a2-9968-53efbbfcec0d service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] No waiting events found dispatching network-vif-plugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:36:21 user nova-compute[76815]: WARNING nova.compute.manager [req-03e68483-49a1-4add-b980-a6639172705a req-f4a84d2c-b87e-47a2-9968-53efbbfcec0d service nova] [instance: 44223f88-c27a-4240-a6c8-754379a66a77] Received unexpected event network-vif-plugged-6ddc3be6-38c2-4ffb-bbd9-b5c3ce1d27e9 for instance with vm_state deleted and task_state None.
Nov 14 22:36:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:36:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:36:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:36:51 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:36:52 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:36:52 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:36:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=25.044815063476562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:36:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:36:53 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:36:53 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:36:53 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:36:53 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:36:53 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:36:53 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:36:53 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:36:53 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:36:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:36:54 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:54 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:54 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:36:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:36:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:36:54 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:36:54 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updating instance_info_cache with network_info: [{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:36:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:36:54 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:36:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:36:56 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:56 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:56 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:36:56 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:36:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:37:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:01 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:37:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:37:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:37:13 user nova-compute[76815]: INFO nova.compute.claims [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Claim successful on node user
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:37:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.policy [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26aadea3a6964715be30b0fbb2c61c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd690e5ff8584e2f9e24597816d90b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:37:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Creating image(s)
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "/opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "/opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk 1073741824" returned: 0 in 0.052s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Successfully created port: 57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.167s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Cannot resize image /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Ensure instance console log exists: /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:14 user nova-compute[76815]: INFO nova.compute.manager [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Detaching volume 52a53a11-3c08-4a00-b147-7d708f6c8b83
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Successfully updated port: 57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:37:15 user nova-compute[76815]: INFO nova.virt.block_device [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Attempting to driver detach volume 52a53a11-3c08-4a00-b147-7d708f6c8b83 from mountpoint /dev/vdb
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-24487c39-cdc6-4244-abbd-a561211c6ae9 req-db3badfd-ffa0-418d-bc4c-6e67330aca53 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received event network-changed-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-24487c39-cdc6-4244-abbd-a561211c6ae9 req-db3badfd-ffa0-418d-bc4c-6e67330aca53 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Refreshing instance network info cache due to event network-changed-57ed7239-bd36-4571-89bb-e1d67d7103ac. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-24487c39-cdc6-4244-abbd-a561211c6ae9 req-db3badfd-ffa0-418d-bc4c-6e67330aca53 service nova] Acquiring lock "refresh_cache-2ced8c09-4383-4145-b939-1a0c730e10ca" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-24487c39-cdc6-4244-abbd-a561211c6ae9 req-db3badfd-ffa0-418d-bc4c-6e67330aca53 service nova] Acquired lock "refresh_cache-2ced8c09-4383-4145-b939-1a0c730e10ca" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-24487c39-cdc6-4244-abbd-a561211c6ae9 req-db3badfd-ffa0-418d-bc4c-6e67330aca53 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Refreshing network info cache for port 57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "refresh_cache-2ced8c09-4383-4145-b939-1a0c730e10ca" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Attempting to detach device vdb from instance 4726306c-2d1d-4395-af5c-bcb631d47e3a from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:37:15 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:37:15 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:37:15 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:37:15 user nova-compute[76815]:   <serial>52a53a11-3c08-4a00-b147-7d708f6c8b83</serial>
Nov 14 22:37:15 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 22:37:15 user nova-compute[76815]: </disk>
Nov 14 22:37:15 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:37:15 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully detached device vdb from instance 4726306c-2d1d-4395-af5c-bcb631d47e3a from the persistent domain config.
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4726306c-2d1d-4395-af5c-bcb631d47e3a from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:37:15 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:37:15 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:37:15 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:37:15 user nova-compute[76815]:   <serial>52a53a11-3c08-4a00-b147-7d708f6c8b83</serial>
Nov 14 22:37:15 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 22:37:15 user nova-compute[76815]: </disk>
Nov 14 22:37:15 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-24487c39-cdc6-4244-abbd-a561211c6ae9 req-db3badfd-ffa0-418d-bc4c-6e67330aca53 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-24487c39-cdc6-4244-abbd-a561211c6ae9 req-db3badfd-ffa0-418d-bc4c-6e67330aca53 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-24487c39-cdc6-4244-abbd-a561211c6ae9 req-db3badfd-ffa0-418d-bc4c-6e67330aca53 service nova] Releasing lock "refresh_cache-2ced8c09-4383-4145-b939-1a0c730e10ca" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquired lock "refresh_cache-2ced8c09-4383-4145-b939-1a0c730e10ca" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Updating instance_info_cache with network_info: [{"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Releasing lock "refresh_cache-2ced8c09-4383-4145-b939-1a0c730e10ca" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Instance network_info: |[{"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Start _get_guest_xml network_info=[{"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:37:15 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:37:15 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-13649080',display_name='tempest-AttachVolumeNegativeTest-server-13649080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-13649080',id=45,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj4pWVk5tqtaVTRfMMPoQCUeyQ8d0++F9f076UwuYiAjs7xb+NaTU4YXfhMX/8R8GTVygbzy0eA37jt+9W72Li0yN662abrUc/7YhIDSc+OmPzMnokv5gtl+XdN4t4Efw==',key_name='tempest-keypair-405332309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-k867hj1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=2ced8c09-4383-4145-b939-1a0c730e10ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:c6,bridge_name='br-int',has_traffic_filtering=True,id=57ed7239-bd36-4571-89bb-e1d67d7103ac,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ed7239-bd') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.objects.instance [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ced8c09-4383-4145-b939-1a0c730e10ca {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:37:15 user nova-compute[76815]:   <uuid>2ced8c09-4383-4145-b939-1a0c730e10ca</uuid>
Nov 14 22:37:15 user nova-compute[76815]:   <name>instance-0000002d</name>
Nov 14 22:37:15 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:37:15 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:37:15 user nova-compute[76815]:   <metadata>
Nov 14 22:37:15 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:37:15 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:37:15 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeNegativeTest-server-13649080</nova:name>
Nov 14 22:37:15 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:37:15</nova:creationTime>
Nov 14 22:37:15 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:37:15 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:37:15 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:37:15 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:37:15 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:37:15 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:37:15 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:37:15 user nova-compute[76815]:       <nova:owner>
Nov 14 22:37:15 user nova-compute[76815]:         <nova:user uuid="26aadea3a6964715be30b0fbb2c61c6b">tempest-AttachVolumeNegativeTest-716641985-project-member</nova:user>
Nov 14 22:37:15 user nova-compute[76815]:         <nova:project uuid="fd690e5ff8584e2f9e24597816d90b98">tempest-AttachVolumeNegativeTest-716641985</nova:project>
Nov 14 22:37:15 user nova-compute[76815]:       </nova:owner>
Nov 14 22:37:15 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:37:15 user nova-compute[76815]:       <nova:ports>
Nov 14 22:37:15 user nova-compute[76815]:         <nova:port uuid="57ed7239-bd36-4571-89bb-e1d67d7103ac">
Nov 14 22:37:15 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:37:15 user nova-compute[76815]:         </nova:port>
Nov 14 22:37:15 user nova-compute[76815]:       </nova:ports>
Nov 14 22:37:15 user nova-compute[76815]:     </nova:instance>
Nov 14 22:37:15 user nova-compute[76815]:   </metadata>
Nov 14 22:37:15 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:37:15 user nova-compute[76815]:     <system>
Nov 14 22:37:15 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:37:15 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:37:15 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:37:15 user nova-compute[76815]:       <entry name="serial">2ced8c09-4383-4145-b939-1a0c730e10ca</entry>
Nov 14 22:37:15 user nova-compute[76815]:       <entry name="uuid">2ced8c09-4383-4145-b939-1a0c730e10ca</entry>
Nov 14 22:37:15 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:37:15 user nova-compute[76815]:     </system>
Nov 14 22:37:15 user nova-compute[76815]:   </sysinfo>
Nov 14 22:37:15 user nova-compute[76815]:   <os>
Nov 14 22:37:15 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:37:15 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:37:15 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:37:15 user nova-compute[76815]:   </os>
Nov 14 22:37:15 user nova-compute[76815]:   <features>
Nov 14 22:37:15 user nova-compute[76815]:     <acpi/>
Nov 14 22:37:15 user nova-compute[76815]:     <apic/>
Nov 14 22:37:15 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:37:15 user nova-compute[76815]:   </features>
Nov 14 22:37:15 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:37:15 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:37:15 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:37:15 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:37:15 user nova-compute[76815]:   </clock>
Nov 14 22:37:15 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:37:15 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:37:15 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:37:15 user nova-compute[76815]:   </cpu>
Nov 14 22:37:15 user nova-compute[76815]:   <devices>
Nov 14 22:37:15 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:37:15 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:37:15 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk"/>
Nov 14 22:37:15 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:37:15 user nova-compute[76815]:     </disk>
Nov 14 22:37:15 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:37:15 user nova-compute[76815]:       <mac address="fa:16:3e:5e:6d:c6"/>
Nov 14 22:37:15 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:37:15 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:37:15 user nova-compute[76815]:       <target dev="tap57ed7239-bd"/>
Nov 14 22:37:15 user nova-compute[76815]:     </interface>
Nov 14 22:37:15 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:37:15 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/console.log" append="off"/>
Nov 14 22:37:15 user nova-compute[76815]:     </serial>
Nov 14 22:37:15 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:37:15 user nova-compute[76815]:     <video>
Nov 14 22:37:15 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:37:15 user nova-compute[76815]:     </video>
Nov 14 22:37:15 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:37:15 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:37:15 user nova-compute[76815]:     </rng>
Nov 14 22:37:15 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:37:15 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:37:15 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:37:15 user nova-compute[76815]:     </memballoon>
Nov 14 22:37:15 user nova-compute[76815]:   </devices>
Nov 14 22:37:15 user nova-compute[76815]: </domain>
Nov 14 22:37:15 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-13649080',display_name='tempest-AttachVolumeNegativeTest-server-13649080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-13649080',id=45,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj4pWVk5tqtaVTRfMMPoQCUeyQ8d0++F9f076UwuYiAjs7xb+NaTU4YXfhMX/8R8GTVygbzy0eA37jt+9W72Li0yN662abrUc/7YhIDSc+OmPzMnokv5gtl+XdN4t4Efw==',key_name='tempest-keypair-405332309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-k867hj1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=2ced8c09-4383-4145-b939-1a0c730e10ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:c6,bridge_name='br-int',has_traffic_filtering=True,id=57ed7239-bd36-4571-89bb-e1d67d7103ac,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ed7239-bd') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG os_vif [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:c6,bridge_name='br-int',has_traffic_filtering=True,id=57ed7239-bd36-4571-89bb-e1d67d7103ac,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ed7239-bd') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '852120db-dd86-5145-96aa-a43670dff6fd', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57ed7239-bd, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57ed7239-bd, col_values=(('qos', UUID('c68af97c-d2fc-4296-8878-959e58040d97')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57ed7239-bd, col_values=(('external_ids', {'iface-id': '57ed7239-bd36-4571-89bb-e1d67d7103ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:6d:c6', 'vm-uuid': '2ced8c09-4383-4145-b939-1a0c730e10ca'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:15 user nova-compute[76815]: INFO os_vif [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6d:c6,bridge_name='br-int',has_traffic_filtering=True,id=57ed7239-bd36-4571-89bb-e1d67d7103ac,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ed7239-bd')
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:37:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No VIF found with MAC fa:16:3e:5e:6d:c6, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:37:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-34035f1e-228e-486a-a278-347bf976178f req-959f0e2a-94ea-413f-bb67-2bba1bd40955 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received event network-vif-plugged-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-34035f1e-228e-486a-a278-347bf976178f req-959f0e2a-94ea-413f-bb67-2bba1bd40955 service nova] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-34035f1e-228e-486a-a278-347bf976178f req-959f0e2a-94ea-413f-bb67-2bba1bd40955 service nova] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-34035f1e-228e-486a-a278-347bf976178f req-959f0e2a-94ea-413f-bb67-2bba1bd40955 service nova] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-34035f1e-228e-486a-a278-347bf976178f req-959f0e2a-94ea-413f-bb67-2bba1bd40955 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] No waiting events found dispatching network-vif-plugged-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:37:17 user nova-compute[76815]: WARNING nova.compute.manager [req-34035f1e-228e-486a-a278-347bf976178f req-959f0e2a-94ea-413f-bb67-2bba1bd40955 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received unexpected event network-vif-plugged-57ed7239-bd36-4571-89bb-e1d67d7103ac for instance with vm_state building and task_state spawning.
Nov 14 22:37:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:37:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Instance spawned successfully.
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-98f99cad-7cab-4d62-8ee7-56baf0efe83d req-8cd1a4ec-fe4e-49af-ae1e-32a9cb21b1fa service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received event network-vif-plugged-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-98f99cad-7cab-4d62-8ee7-56baf0efe83d req-8cd1a4ec-fe4e-49af-ae1e-32a9cb21b1fa service nova] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-98f99cad-7cab-4d62-8ee7-56baf0efe83d req-8cd1a4ec-fe4e-49af-ae1e-32a9cb21b1fa service nova] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-98f99cad-7cab-4d62-8ee7-56baf0efe83d req-8cd1a4ec-fe4e-49af-ae1e-32a9cb21b1fa service nova] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-98f99cad-7cab-4d62-8ee7-56baf0efe83d req-8cd1a4ec-fe4e-49af-ae1e-32a9cb21b1fa service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] No waiting events found dispatching network-vif-plugged-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:37:19 user nova-compute[76815]: WARNING nova.compute.manager [req-98f99cad-7cab-4d62-8ee7-56baf0efe83d req-8cd1a4ec-fe4e-49af-ae1e-32a9cb21b1fa service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received unexpected event network-vif-plugged-57ed7239-bd36-4571-89bb-e1d67d7103ac for instance with vm_state building and task_state spawning.
Nov 14 22:37:19 user nova-compute[76815]: INFO nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 14 22:37:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:37:19 user nova-compute[76815]: INFO nova.compute.manager [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Took 6.10 seconds to build instance.
Nov 14 22:37:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-d6b904e0-ded2-40ad-87e9-ffd53cd5e3e6 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.201s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:35 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4726306c-2d1d-4395-af5c-bcb631d47e3a is timed out.
Nov 14 22:37:35 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully detached device vdb from instance 4726306c-2d1d-4395-af5c-bcb631d47e3a from the live domain config.
Nov 14 22:37:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'flVIrYBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:37:35 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ddd8f5-ce91-4996-99e6-28e0807a4116]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:37:35 user nova-compute[76815]: No targets found.
Nov 14 22:37:35 user nova-compute[76815]: iSNS:
Nov 14 22:37:35 user nova-compute[76815]: No targets found.
Nov 14 22:37:35 user nova-compute[76815]: STATIC:
Nov 14 22:37:35 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83
Nov 14 22:37:35 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:37:35 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:37:35 user nova-compute[76815]: FIRMWARE:
Nov 14 22:37:35 user nova-compute[76815]: No targets found.
Nov 14 22:37:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:37:35 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:37:35 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ca5776-ff0c-46d4-9e4c-a467a2b482c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d475772-7278-4114-945b-4ea71da2b0e3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:37:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 (non-flash)
Nov 14 22:37:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8598ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b607f39-7f68-4011-9b63-33d41d7f4c87]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d4bdbe-3a6e-43f4-a8e9-9385dbbb7a64]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d1f7c6-eaea-4a04-80bb-aec1e64b4288]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e05c182-52b6-432f-95db-89a0a72746c5]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b85643-ecd2-4603-b99f-a0e9da720541]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade6f85-0952-41b0-9ec1-50caa1d170e2]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260]
Nov 14 22:37:35 user nova-compute[76815]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83, portal: 172.16.0.220,3260] successful.
Nov 14 22:37:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a53a11-3c08-4a00-b147-7d708f6c8b83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9982a0b-dbca-4efc-b4a9-4a29555a9439]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== disconnect_volume: return (276ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:37:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:37:36 user nova-compute[76815]: DEBUG nova.objects.instance [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-606dbb0a-3da5-4adb-88ae-413a7e3213d4 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.940s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8d3af3d9-724e-4781-9079-f8f1d332e8ca tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8d3af3d9-724e-4781-9079-f8f1d332e8ca tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8d3af3d9-724e-4781-9079-f8f1d332e8ca tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8d3af3d9-724e-4781-9079-f8f1d332e8ca tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=76815) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG nova.objects.instance [None req-8d3af3d9-724e-4781-9079-f8f1d332e8ca tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-b32a7853-a824-423d-abfb-f0d1e3c26462 req-a275a704-3afa-4697-8fd4-363766d07590 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-unplugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b32a7853-a824-423d-abfb-f0d1e3c26462 req-a275a704-3afa-4697-8fd4-363766d07590 service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b32a7853-a824-423d-abfb-f0d1e3c26462 req-a275a704-3afa-4697-8fd4-363766d07590 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b32a7853-a824-423d-abfb-f0d1e3c26462 req-a275a704-3afa-4697-8fd4-363766d07590 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-b32a7853-a824-423d-abfb-f0d1e3c26462 req-a275a704-3afa-4697-8fd4-363766d07590 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-unplugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:37:37 user nova-compute[76815]: WARNING nova.compute.manager [req-b32a7853-a824-423d-abfb-f0d1e3c26462 req-a275a704-3afa-4697-8fd4-363766d07590 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-unplugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state active and task_state powering-off.
Nov 14 22:37:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance destroyed successfully.
Nov 14 22:37:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-8d3af3d9-724e-4781-9079-f8f1d332e8ca tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:37:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8d3af3d9-724e-4781-9079-f8f1d332e8ca tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.828s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-12b36d43-de11-4944-afd9-826d3c6c931b req-06d919f4-3cd3-44c6-93f5-bcadb46c582e service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:37:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-12b36d43-de11-4944-afd9-826d3c6c931b req-06d919f4-3cd3-44c6-93f5-bcadb46c582e service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-12b36d43-de11-4944-afd9-826d3c6c931b req-06d919f4-3cd3-44c6-93f5-bcadb46c582e service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-12b36d43-de11-4944-afd9-826d3c6c931b req-06d919f4-3cd3-44c6-93f5-bcadb46c582e service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-12b36d43-de11-4944-afd9-826d3c6c931b req-06d919f4-3cd3-44c6-93f5-bcadb46c582e service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:37:39 user nova-compute[76815]: WARNING nova.compute.manager [req-12b36d43-de11-4944-afd9-826d3c6c931b req-06d919f4-3cd3-44c6-93f5-bcadb46c582e service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state stopped and task_state None.
Nov 14 22:37:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:46 user nova-compute[76815]: INFO nova.compute.manager [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Rescuing
Nov 14 22:37:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:37:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquired lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:37:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:37:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:37:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Releasing lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-1740938f-a057-4112-ae52-4747b71aa028 req-0b4a7d18-7319-4376-a952-622852c9514c service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-unplugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1740938f-a057-4112-ae52-4747b71aa028 req-0b4a7d18-7319-4376-a952-622852c9514c service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1740938f-a057-4112-ae52-4747b71aa028 req-0b4a7d18-7319-4376-a952-622852c9514c service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1740938f-a057-4112-ae52-4747b71aa028 req-0b4a7d18-7319-4376-a952-622852c9514c service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-1740938f-a057-4112-ae52-4747b71aa028 req-0b4a7d18-7319-4376-a952-622852c9514c service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-unplugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:37:47 user nova-compute[76815]: WARNING nova.compute.manager [req-1740938f-a057-4112-ae52-4747b71aa028 req-0b4a7d18-7319-4376-a952-622852c9514c service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-unplugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state active and task_state rescuing.
Nov 14 22:37:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 92a51373-b728-4a91-a503-a87740e84895] Instance destroyed successfully.
Nov 14 22:37:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Attempting rescue
Nov 14 22:37:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Instance directory exists: not creating {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 22:37:47 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Creating image(s)
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue" returned: 0 in 0.063s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:47 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'migration_context' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.objects.base [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<92a51373-b728-4a91-a503-a87740e84895> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Start _get_guest_xml network_info=[{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "vif_mac": "fa:16:3e:ca:4f:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'resources' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.objects.base [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<92a51373-b728-4a91-a503-a87740e84895> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'numa_topology' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.objects.base [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<92a51373-b728-4a91-a503-a87740e84895> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:37:48 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:37:48 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.objects.base [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<92a51373-b728-4a91-a503-a87740e84895> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1645363141',display_name='tempest-ServerRescueNegativeTestJSON-server-1645363141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1645363141',id=43,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-fcbmz118',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:33:10Z,user_data=None,user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=92a51373-b728-4a91-a503-a87740e84895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "vif_mac": "fa:16:3e:ca:4f:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "vif_mac": "fa:16:3e:ca:4f:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=cc87e561-54f9-4667-9c88-0e0844042c51,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc87e561-54') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'pci_devices' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.objects.base [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<92a51373-b728-4a91-a503-a87740e84895> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:37:48 user nova-compute[76815]:   <uuid>92a51373-b728-4a91-a503-a87740e84895</uuid>
Nov 14 22:37:48 user nova-compute[76815]:   <name>instance-0000002b</name>
Nov 14 22:37:48 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:37:48 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:37:48 user nova-compute[76815]:   <metadata>
Nov 14 22:37:48 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:37:48 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:37:48 user nova-compute[76815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1645363141</nova:name>
Nov 14 22:37:48 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:37:48</nova:creationTime>
Nov 14 22:37:48 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:37:48 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:37:48 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:37:48 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:37:48 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:37:48 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:37:48 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:37:48 user nova-compute[76815]:       <nova:owner>
Nov 14 22:37:48 user nova-compute[76815]:         <nova:user uuid="d7726302e74c45ba94acea58ff3ca7c6">tempest-ServerRescueNegativeTestJSON-1323022133-project-member</nova:user>
Nov 14 22:37:48 user nova-compute[76815]:         <nova:project uuid="b06ff4e376e9419babeacd8a4d586574">tempest-ServerRescueNegativeTestJSON-1323022133</nova:project>
Nov 14 22:37:48 user nova-compute[76815]:       </nova:owner>
Nov 14 22:37:48 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:37:48 user nova-compute[76815]:       <nova:ports>
Nov 14 22:37:48 user nova-compute[76815]:         <nova:port uuid="cc87e561-54f9-4667-9c88-0e0844042c51">
Nov 14 22:37:48 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 22:37:48 user nova-compute[76815]:         </nova:port>
Nov 14 22:37:48 user nova-compute[76815]:       </nova:ports>
Nov 14 22:37:48 user nova-compute[76815]:     </nova:instance>
Nov 14 22:37:48 user nova-compute[76815]:   </metadata>
Nov 14 22:37:48 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:37:48 user nova-compute[76815]:     <system>
Nov 14 22:37:48 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:37:48 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:37:48 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:37:48 user nova-compute[76815]:       <entry name="serial">92a51373-b728-4a91-a503-a87740e84895</entry>
Nov 14 22:37:48 user nova-compute[76815]:       <entry name="uuid">92a51373-b728-4a91-a503-a87740e84895</entry>
Nov 14 22:37:48 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:37:48 user nova-compute[76815]:     </system>
Nov 14 22:37:48 user nova-compute[76815]:   </sysinfo>
Nov 14 22:37:48 user nova-compute[76815]:   <os>
Nov 14 22:37:48 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:37:48 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:37:48 user nova-compute[76815]:   </os>
Nov 14 22:37:48 user nova-compute[76815]:   <features>
Nov 14 22:37:48 user nova-compute[76815]:     <acpi/>
Nov 14 22:37:48 user nova-compute[76815]:     <apic/>
Nov 14 22:37:48 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:37:48 user nova-compute[76815]:   </features>
Nov 14 22:37:48 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:37:48 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:37:48 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:37:48 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:37:48 user nova-compute[76815]:   </clock>
Nov 14 22:37:48 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:37:48 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:37:48 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:37:48 user nova-compute[76815]:   </cpu>
Nov 14 22:37:48 user nova-compute[76815]:   <devices>
Nov 14 22:37:48 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:37:48 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:37:48 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue"/>
Nov 14 22:37:48 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:37:48 user nova-compute[76815]:     </disk>
Nov 14 22:37:48 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:37:48 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:37:48 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk"/>
Nov 14 22:37:48 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:37:48 user nova-compute[76815]:     </disk>
Nov 14 22:37:48 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:37:48 user nova-compute[76815]:       <mac address="fa:16:3e:ca:4f:31"/>
Nov 14 22:37:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:37:48 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:37:48 user nova-compute[76815]:       <target dev="tapcc87e561-54"/>
Nov 14 22:37:48 user nova-compute[76815]:     </interface>
Nov 14 22:37:48 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:37:48 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/console.log" append="off"/>
Nov 14 22:37:48 user nova-compute[76815]:     </serial>
Nov 14 22:37:48 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:37:48 user nova-compute[76815]:     <video>
Nov 14 22:37:48 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:37:48 user nova-compute[76815]:     </video>
Nov 14 22:37:48 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:37:48 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:37:48 user nova-compute[76815]:     </rng>
Nov 14 22:37:48 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:37:48 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:37:48 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:37:48 user nova-compute[76815]:     </memballoon>
Nov 14 22:37:48 user nova-compute[76815]:   </devices>
Nov 14 22:37:48 user nova-compute[76815]: </domain>
Nov 14 22:37:48 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:37:48 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 92a51373-b728-4a91-a503-a87740e84895] Instance destroyed successfully.
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:37:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No VIF found with MAC fa:16:3e:ca:4f:31, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:37:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-06eb0496-a6d6-46f5-91e8-19d6cbe3503c req-bfcbdfc6-9b41-4d0b-bc39-273d16e7fc9d service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:37:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-06eb0496-a6d6-46f5-91e8-19d6cbe3503c req-bfcbdfc6-9b41-4d0b-bc39-273d16e7fc9d service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-06eb0496-a6d6-46f5-91e8-19d6cbe3503c req-bfcbdfc6-9b41-4d0b-bc39-273d16e7fc9d service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-06eb0496-a6d6-46f5-91e8-19d6cbe3503c req-bfcbdfc6-9b41-4d0b-bc39-273d16e7fc9d service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-06eb0496-a6d6-46f5-91e8-19d6cbe3503c req-bfcbdfc6-9b41-4d0b-bc39-273d16e7fc9d service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:37:49 user nova-compute[76815]: WARNING nova.compute.manager [req-06eb0496-a6d6-46f5-91e8-19d6cbe3503c req-bfcbdfc6-9b41-4d0b-bc39-273d16e7fc9d service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state active and task_state rescuing.
Nov 14 22:37:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:37:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:37:51 user nova-compute[76815]: WARNING nova.compute.manager [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state active and task_state rescuing.
Nov 14 22:37:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:37:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:37:51 user nova-compute[76815]: WARNING nova.compute.manager [req-f0b57129-2274-4212-9a82-19436c44df22 req-78bd031c-9ad9-40cc-8fd4-3d82a82121ba service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state active and task_state rescuing.
Nov 14 22:37:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2619b65e-897e-45aa-ac28-cf5c5b88dd27 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:37:54 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:37:54 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.013851165771484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2ced8c09-4383-4145-b939-1a0c730e10ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:37:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:37:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:37:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:37:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:37:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:37:55 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:37:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:37:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:37:56 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:37:56 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:37:56 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updating instance_info_cache with network_info: [{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:37:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:37:56 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:37:56 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:37:56 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:37:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:37:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:37:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:38:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:38:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:38:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:38:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:38:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:38:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:38:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:52 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:38:54 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:38:54 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:38:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.012954711914062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2ced8c09-4383-4145-b939-1a0c730e10ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:38:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:38:55 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:38:55 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:38:55 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:38:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:38:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:38:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:39:00 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-1c5e2ada-73be-4e1b-a935-7126471b0b97 req-c9ca2a32-cb5b-4eb2-a12a-db72cbd841ac service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received event network-changed-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:39:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-1c5e2ada-73be-4e1b-a935-7126471b0b97 req-c9ca2a32-cb5b-4eb2-a12a-db72cbd841ac service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Refreshing instance network info cache due to event network-changed-57ed7239-bd36-4571-89bb-e1d67d7103ac. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:39:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c5e2ada-73be-4e1b-a935-7126471b0b97 req-c9ca2a32-cb5b-4eb2-a12a-db72cbd841ac service nova] Acquiring lock "refresh_cache-2ced8c09-4383-4145-b939-1a0c730e10ca" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:39:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c5e2ada-73be-4e1b-a935-7126471b0b97 req-c9ca2a32-cb5b-4eb2-a12a-db72cbd841ac service nova] Acquired lock "refresh_cache-2ced8c09-4383-4145-b939-1a0c730e10ca" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:39:03 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c5e2ada-73be-4e1b-a935-7126471b0b97 req-c9ca2a32-cb5b-4eb2-a12a-db72cbd841ac service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Refreshing network info cache for port 57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:39:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c5e2ada-73be-4e1b-a935-7126471b0b97 req-c9ca2a32-cb5b-4eb2-a12a-db72cbd841ac service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Updated VIF entry in instance network info cache for port 57ed7239-bd36-4571-89bb-e1d67d7103ac. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:39:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c5e2ada-73be-4e1b-a935-7126471b0b97 req-c9ca2a32-cb5b-4eb2-a12a-db72cbd841ac service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Updating instance_info_cache with network_info: [{"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:39:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c5e2ada-73be-4e1b-a935-7126471b0b97 req-c9ca2a32-cb5b-4eb2-a12a-db72cbd841ac service nova] Releasing lock "refresh_cache-2ced8c09-4383-4145-b939-1a0c730e10ca" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG nova.objects.instance [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'flavor' on Instance uuid 2ced8c09-4383-4145-b939-1a0c730e10ca {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:05 user nova-compute[76815]: INFO nova.compute.manager [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Attaching volume a64e2a9c-abcd-4251-a1df-83663975b298 to /dev/vdb
Nov 14 22:39:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG os_brick.utils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83f3d1d-5270-4f3c-a2a6-b7db4e06c416]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d743aa5f-e060-429e-9f4c-291014389672]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cfe43b-d6eb-4a35-b821-bd20d134c76e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cad56aa-36eb-4987-93a9-c2261d6bcde8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:39:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:39:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:39:06 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:39:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d8ea7c-a8f9-44a5-9047-82bb30f2ba9d]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:39:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:39:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:39:06 user nova-compute[76815]: DEBUG os_brick.utils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:39:06 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Updating existing volume attachment record: 981126d9-21c5-47f8-9d64-1204a30d0e1f {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:39:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXYFMQPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:39:11 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:39:11 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:39:11 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578a494-0ac1-442e-b72e-e90a331ab7d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:39:11 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c676ef-6272-43fb-892e-32c3333a4e15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298] added
Nov 14 22:39:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d0dd81-f444-4b3d-96dd-821586e98e90]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b94dd-e1bc-4361-a4c4-63ab6eaf578f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXYFMQPK {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gXYFMQPK" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a610b30d-d1bc-4d0b-8e2a-c916fefc17ae]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gXYFMQPK'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb86691e-c9d8-4f61-a0d2-b905592c1479]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a26f36-d98a-4e11-99e8-43fd2719c538]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:39:11 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:39:11 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:39:11 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:39:11 user nova-compute[76815]: 
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[066d684b-3d8b-4334-970d-f54571e5a5d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298, portal: 172.16.0.220,3260]
Nov 14 22:39:11 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298, portal: 172.16.0.220,3260] successful.
Nov 14 22:39:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c34b283-09bc-4092-914c-0fdbd2339b6d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[db90ccf5-5539-44f8-9d45-d93c1b4e3d33]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 (non-flash)
Nov 14 22:39:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 (non-flash)
Nov 14 22:39:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac0c7f7-49bd-45d3-9ef0-8c8bf38eb97d]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXYFMQPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23032326163393061', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032326163393061', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG nova.objects.instance [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'flavor' on Instance uuid 2ced8c09-4383-4145-b939-1a0c730e10ca {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:39:12 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:39:12 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:39:12 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:39:12 user nova-compute[76815]:   <serial>a64e2a9c-abcd-4251-a1df-83663975b298</serial>
Nov 14 22:39:12 user nova-compute[76815]: </disk>
Nov 14 22:39:12 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No VIF found with MAC fa:16:3e:5e:6d:c6, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:39:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-67229267-a31f-4920-aee5-3f78dcb153b5 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.207s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:13 user nova-compute[76815]: INFO nova.compute.manager [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Detaching volume a64e2a9c-abcd-4251-a1df-83663975b298
Nov 14 22:39:13 user nova-compute[76815]: INFO nova.virt.block_device [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Attempting to driver detach volume a64e2a9c-abcd-4251-a1df-83663975b298 from mountpoint /dev/vdb
Nov 14 22:39:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Attempting to detach device vdb from instance 2ced8c09-4383-4145-b939-1a0c730e10ca from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:39:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:39:13 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:39:13 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:39:13 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:39:13 user nova-compute[76815]:   <serial>a64e2a9c-abcd-4251-a1df-83663975b298</serial>
Nov 14 22:39:13 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:39:13 user nova-compute[76815]: </disk>
Nov 14 22:39:13 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:39:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully detached device vdb from instance 2ced8c09-4383-4145-b939-1a0c730e10ca from the persistent domain config.
Nov 14 22:39:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ced8c09-4383-4145-b939-1a0c730e10ca from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:39:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:39:13 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:39:13 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:39:13 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:39:13 user nova-compute[76815]:   <serial>a64e2a9c-abcd-4251-a1df-83663975b298</serial>
Nov 14 22:39:13 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:39:13 user nova-compute[76815]: </disk>
Nov 14 22:39:13 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:39:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ced8c09-4383-4145-b939-1a0c730e10ca {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:39:15 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:18 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:39:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:39:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:39:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:39:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:39:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:39:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquired lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'info_cache' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.base [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updating instance_info_cache with network_info: [{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Releasing lock "refresh_cache-4726306c-2d1d-4395-af5c-bcb631d47e3a" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:39:28 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance destroyed successfully.
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'resources' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.base [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-88532880',display_name='tempest-AttachVolumeTestJSON-server-88532880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-88532880',id=41,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQubaL4MRQuzJoCVwamFoNIlvVZWcGCwACqD1aiy1LaEn8qAs7tkZ5TTctrQdfL2x8ZstSYKMLnmOAaQmEsNBAZvuRmZsqzswxqjPsbJlZXq1ikUWRFm/k6lX6ZPoGyzg==',key_name='tempest-keypair-2014797013',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-436ixbo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=4726306c-2d1d-4395-af5c-bcb631d47e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG os_vif [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecc05760-8b, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e0278f2-1969-4646-8124-510c93568d44) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:28 user nova-compute[76815]: INFO os_vif [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b')
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Start _get_guest_xml network_info=[{"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'numa_topology' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.base [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:39:28 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:39:28 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.base [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-88532880',display_name='tempest-AttachVolumeTestJSON-server-88532880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-88532880',id=41,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQubaL4MRQuzJoCVwamFoNIlvVZWcGCwACqD1aiy1LaEn8qAs7tkZ5TTctrQdfL2x8ZstSYKMLnmOAaQmEsNBAZvuRmZsqzswxqjPsbJlZXq1ikUWRFm/k6lX6ZPoGyzg==',key_name='tempest-keypair-2014797013',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-436ixbo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=4726306c-2d1d-4395-af5c-bcb631d47e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'pci_devices' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.objects.base [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:39:28 user nova-compute[76815]:   <uuid>4726306c-2d1d-4395-af5c-bcb631d47e3a</uuid>
Nov 14 22:39:28 user nova-compute[76815]:   <name>instance-00000029</name>
Nov 14 22:39:28 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:39:28 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:39:28 user nova-compute[76815]:   <metadata>
Nov 14 22:39:28 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:39:28 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:39:28 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeTestJSON-server-88532880</nova:name>
Nov 14 22:39:28 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:39:28</nova:creationTime>
Nov 14 22:39:28 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:39:28 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:39:28 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:39:28 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:39:28 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:39:28 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:39:28 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:39:28 user nova-compute[76815]:       <nova:owner>
Nov 14 22:39:28 user nova-compute[76815]:         <nova:user uuid="3590183279e742f0bced96008d784cfb">tempest-AttachVolumeTestJSON-252609817-project-member</nova:user>
Nov 14 22:39:28 user nova-compute[76815]:         <nova:project uuid="e13ac882a01d4abfa130458292b5cd40">tempest-AttachVolumeTestJSON-252609817</nova:project>
Nov 14 22:39:28 user nova-compute[76815]:       </nova:owner>
Nov 14 22:39:28 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:39:28 user nova-compute[76815]:       <nova:ports>
Nov 14 22:39:28 user nova-compute[76815]:         <nova:port uuid="ecc05760-8b9f-47c6-aa52-6ada01978b59">
Nov 14 22:39:28 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 22:39:28 user nova-compute[76815]:         </nova:port>
Nov 14 22:39:28 user nova-compute[76815]:       </nova:ports>
Nov 14 22:39:28 user nova-compute[76815]:     </nova:instance>
Nov 14 22:39:28 user nova-compute[76815]:   </metadata>
Nov 14 22:39:28 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:39:28 user nova-compute[76815]:     <system>
Nov 14 22:39:28 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:39:28 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:39:28 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:39:28 user nova-compute[76815]:       <entry name="serial">4726306c-2d1d-4395-af5c-bcb631d47e3a</entry>
Nov 14 22:39:28 user nova-compute[76815]:       <entry name="uuid">4726306c-2d1d-4395-af5c-bcb631d47e3a</entry>
Nov 14 22:39:28 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:39:28 user nova-compute[76815]:     </system>
Nov 14 22:39:28 user nova-compute[76815]:   </sysinfo>
Nov 14 22:39:28 user nova-compute[76815]:   <os>
Nov 14 22:39:28 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:39:28 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:39:28 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:39:28 user nova-compute[76815]:   </os>
Nov 14 22:39:28 user nova-compute[76815]:   <features>
Nov 14 22:39:28 user nova-compute[76815]:     <acpi/>
Nov 14 22:39:28 user nova-compute[76815]:     <apic/>
Nov 14 22:39:28 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:39:28 user nova-compute[76815]:   </features>
Nov 14 22:39:28 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:39:28 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:39:28 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:39:28 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:39:28 user nova-compute[76815]:   </clock>
Nov 14 22:39:28 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:39:28 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:39:28 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:39:28 user nova-compute[76815]:   </cpu>
Nov 14 22:39:28 user nova-compute[76815]:   <devices>
Nov 14 22:39:28 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:39:28 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:39:28 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk"/>
Nov 14 22:39:28 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:39:28 user nova-compute[76815]:     </disk>
Nov 14 22:39:28 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:39:28 user nova-compute[76815]:       <mac address="fa:16:3e:c4:49:e2"/>
Nov 14 22:39:28 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:39:28 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:39:28 user nova-compute[76815]:       <target dev="tapecc05760-8b"/>
Nov 14 22:39:28 user nova-compute[76815]:     </interface>
Nov 14 22:39:28 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:39:28 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/console.log" append="off"/>
Nov 14 22:39:28 user nova-compute[76815]:     </serial>
Nov 14 22:39:28 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:39:28 user nova-compute[76815]:     <video>
Nov 14 22:39:28 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:39:28 user nova-compute[76815]:     </video>
Nov 14 22:39:28 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:39:28 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:39:28 user nova-compute[76815]:     </rng>
Nov 14 22:39:28 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:39:28 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:39:28 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:39:28 user nova-compute[76815]:     </memballoon>
Nov 14 22:39:28 user nova-compute[76815]:   </devices>
Nov 14 22:39:28 user nova-compute[76815]: </domain>
Nov 14 22:39:28 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG nova.objects.base [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Cannot resize image /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'migration_context' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG nova.objects.base [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Object Instance<4726306c-2d1d-4395-af5c-bcb631d47e3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-88532880',display_name='tempest-AttachVolumeTestJSON-server-88532880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-88532880',id=41,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQubaL4MRQuzJoCVwamFoNIlvVZWcGCwACqD1aiy1LaEn8qAs7tkZ5TTctrQdfL2x8ZstSYKMLnmOAaQmEsNBAZvuRmZsqzswxqjPsbJlZXq1ikUWRFm/k6lX6ZPoGyzg==',key_name='tempest-keypair-2014797013',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-436ixbo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=4726306c-2d1d-4395-af5c-bcb631d47e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG os_vif [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd63c7f9d-8750-5959-902c-5a9bfc124e22', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecc05760-8b, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecc05760-8b, col_values=(('qos', UUID('2841d0f9-5a53-4aaa-90b1-83921aca5951')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecc05760-8b, col_values=(('external_ids', {'iface-id': 'ecc05760-8b9f-47c6-aa52-6ada01978b59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:49:e2', 'vm-uuid': '4726306c-2d1d-4395-af5c-bcb631d47e3a'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:39:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:29 user nova-compute[76815]: INFO os_vif [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b')
Nov 14 22:39:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-49b6016d-97bc-4f12-a9b2-50ed50182d27 req-626e2324-7031-4dcf-870f-75a393252fd8 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:39:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-49b6016d-97bc-4f12-a9b2-50ed50182d27 req-626e2324-7031-4dcf-870f-75a393252fd8 service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-49b6016d-97bc-4f12-a9b2-50ed50182d27 req-626e2324-7031-4dcf-870f-75a393252fd8 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-49b6016d-97bc-4f12-a9b2-50ed50182d27 req-626e2324-7031-4dcf-870f-75a393252fd8 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-49b6016d-97bc-4f12-a9b2-50ed50182d27 req-626e2324-7031-4dcf-870f-75a393252fd8 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:39:30 user nova-compute[76815]: WARNING nova.compute.manager [req-49b6016d-97bc-4f12-a9b2-50ed50182d27 req-626e2324-7031-4dcf-870f-75a393252fd8 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state stopped and task_state powering-on.
Nov 14 22:39:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:39:32 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance rebooted successfully.
Nov 14 22:39:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f2876d8d-a63c-482a-9e36-c13c05ccae16 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:39:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-169982a6-5d18-4fa4-85a5-3d57e7444fa3 req-345c5913-c033-4854-bc55-cd522cd5b9c5 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:39:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-169982a6-5d18-4fa4-85a5-3d57e7444fa3 req-345c5913-c033-4854-bc55-cd522cd5b9c5 service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-169982a6-5d18-4fa4-85a5-3d57e7444fa3 req-345c5913-c033-4854-bc55-cd522cd5b9c5 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-169982a6-5d18-4fa4-85a5-3d57e7444fa3 req-345c5913-c033-4854-bc55-cd522cd5b9c5 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-169982a6-5d18-4fa4-85a5-3d57e7444fa3 req-345c5913-c033-4854-bc55-cd522cd5b9c5 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:39:33 user nova-compute[76815]: WARNING nova.compute.manager [req-169982a6-5d18-4fa4-85a5-3d57e7444fa3 req-345c5913-c033-4854-bc55-cd522cd5b9c5 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state stopped and task_state powering-on.
Nov 14 22:39:34 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ced8c09-4383-4145-b939-1a0c730e10ca is timed out.
Nov 14 22:39:34 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully detached device vdb from instance 2ced8c09-4383-4145-b939-1a0c730e10ca from the live domain config.
Nov 14 22:39:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gXYFMQPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:39:34 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[073761c7-2f1e-4495-b4b1-4bf5a0aaa330]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:39:34 user nova-compute[76815]: No targets found.
Nov 14 22:39:34 user nova-compute[76815]: iSNS:
Nov 14 22:39:34 user nova-compute[76815]: No targets found.
Nov 14 22:39:34 user nova-compute[76815]: STATIC:
Nov 14 22:39:34 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298
Nov 14 22:39:34 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:39:34 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:39:34 user nova-compute[76815]: FIRMWARE:
Nov 14 22:39:34 user nova-compute[76815]: No targets found.
Nov 14 22:39:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:39:34 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:39:34 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[755cf010-5f41-427a-a748-8c539396aab2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef600852-63b9-4bd9-b24f-8be5299cda98]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 (non-flash)
Nov 14 22:39:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 (non-flash)
Nov 14 22:39:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8599000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34417de-ad42-4f90-b9f0-ff39c6bad2f3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b769af9b-fa51-40c8-ad85-05ffc01a8076]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f97ed2-7448-41e7-b9d4-c25d0c7a8640]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2690e389-799c-4e4a-81e3-114f67f72ff1]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee87e07a-5d03-4aaa-9ca7-519ddc62296e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd18a7-ebde-4624-aa76-91ac699ff0cc]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298, portal: 172.16.0.220,3260]
Nov 14 22:39:34 user nova-compute[76815]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298, portal: 172.16.0.220,3260] successful.
Nov 14 22:39:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a64e2a9c-abcd-4251-a1df-83663975b298 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c758743-9075-4534-9ede-9109101a2d30]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] <== disconnect_volume: return (280ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:39:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:35 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'flavor' on Instance uuid 2ced8c09-4383-4145-b939-1a0c730e10ca {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2ae03594-a7bc-4058-8fbb-bd11195323b0 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.610s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:37 user nova-compute[76815]: INFO nova.compute.manager [None req-f6462614-694d-4dff-9f66-9494c69ba140 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Unrescuing
Nov 14 22:39:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f6462614-694d-4dff-9f66-9494c69ba140 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:39:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f6462614-694d-4dff-9f66-9494c69ba140 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquired lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:39:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f6462614-694d-4dff-9f66-9494c69ba140 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:39:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f6462614-694d-4dff-9f66-9494c69ba140 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:39:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f6462614-694d-4dff-9f66-9494c69ba140 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Releasing lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:39:37 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f6462614-694d-4dff-9f66-9494c69ba140 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'flavor' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:39:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-79d11d8c-851f-4f14-8892-477415b97655 req-39a1c2f0-f82e-4b48-92ea-faec29262974 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-unplugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:39:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79d11d8c-851f-4f14-8892-477415b97655 req-39a1c2f0-f82e-4b48-92ea-faec29262974 service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79d11d8c-851f-4f14-8892-477415b97655 req-39a1c2f0-f82e-4b48-92ea-faec29262974 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79d11d8c-851f-4f14-8892-477415b97655 req-39a1c2f0-f82e-4b48-92ea-faec29262974 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-79d11d8c-851f-4f14-8892-477415b97655 req-39a1c2f0-f82e-4b48-92ea-faec29262974 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-unplugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:39:38 user nova-compute[76815]: WARNING nova.compute.manager [req-79d11d8c-851f-4f14-8892-477415b97655 req-39a1c2f0-f82e-4b48-92ea-faec29262974 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-unplugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:39:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 92a51373-b728-4a91-a503-a87740e84895] Instance destroyed successfully.
Nov 14 22:39:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:39:40 user nova-compute[76815]: WARNING nova.compute.manager [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:39:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:39:40 user nova-compute[76815]: WARNING nova.compute.manager [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:39:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:39:40 user nova-compute[76815]: WARNING nova.compute.manager [req-1d9aefac-53b6-4688-863c-86a4404d1472 req-f0edfdec-b3a7-4913-b2b9-0c0ebf5f25a8 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:39:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f6462614-694d-4dff-9f66-9494c69ba140 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:39:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:39:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:39:56 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:39:56 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=25.010700225830078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 2ced8c09-4383-4145-b939-1a0c730e10ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:39:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:39:57 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:57 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:39:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:39:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:39:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:39:57 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:39:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updating instance_info_cache with network_info: [{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:39:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:39:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:39:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:39:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:39:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:00 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:40:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:04 user nova-compute[76815]: INFO nova.compute.manager [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Terminating instance
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-adc7b450-4406-456f-b7b2-b3b0a9ef5b0e req-6a7fdeeb-45a4-496f-8b54-368c1afd0277 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received event network-vif-unplugged-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-adc7b450-4406-456f-b7b2-b3b0a9ef5b0e req-6a7fdeeb-45a4-496f-8b54-368c1afd0277 service nova] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-adc7b450-4406-456f-b7b2-b3b0a9ef5b0e req-6a7fdeeb-45a4-496f-8b54-368c1afd0277 service nova] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-adc7b450-4406-456f-b7b2-b3b0a9ef5b0e req-6a7fdeeb-45a4-496f-8b54-368c1afd0277 service nova] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-adc7b450-4406-456f-b7b2-b3b0a9ef5b0e req-6a7fdeeb-45a4-496f-8b54-368c1afd0277 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] No waiting events found dispatching network-vif-unplugged-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-adc7b450-4406-456f-b7b2-b3b0a9ef5b0e req-6a7fdeeb-45a4-496f-8b54-368c1afd0277 service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received event network-vif-unplugged-57ed7239-bd36-4571-89bb-e1d67d7103ac for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Instance destroyed successfully.
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.objects.instance [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'resources' on Instance uuid 2ced8c09-4383-4145-b939-1a0c730e10ca {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-13649080',display_name='tempest-AttachVolumeNegativeTest-server-13649080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-13649080',id=45,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj4pWVk5tqtaVTRfMMPoQCUeyQ8d0++F9f076UwuYiAjs7xb+NaTU4YXfhMX/8R8GTVygbzy0eA37jt+9W72Li0yN662abrUc/7YhIDSc+OmPzMnokv5gtl+XdN4t4Efw==',key_name='tempest-keypair-405332309',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-k867hj1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=2ced8c09-4383-4145-b939-1a0c730e10ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "address": "fa:16:3e:5e:6d:c6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ed7239-bd", "ovs_interfaceid": "57ed7239-bd36-4571-89bb-e1d67d7103ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:6d:c6,bridge_name='br-int',has_traffic_filtering=True,id=57ed7239-bd36-4571-89bb-e1d67d7103ac,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ed7239-bd') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG os_vif [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:6d:c6,bridge_name='br-int',has_traffic_filtering=True,id=57ed7239-bd36-4571-89bb-e1d67d7103ac,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ed7239-bd') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57ed7239-bd, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c68af97c-d2fc-4296-8878-959e58040d97) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:40:04 user nova-compute[76815]: INFO os_vif [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:6d:c6,bridge_name='br-int',has_traffic_filtering=True,id=57ed7239-bd36-4571-89bb-e1d67d7103ac,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ed7239-bd')
Nov 14 22:40:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Deleting instance files /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca_del
Nov 14 22:40:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Deletion of /opt/stack/data/nova/instances/2ced8c09-4383-4145-b939-1a0c730e10ca_del complete
Nov 14 22:40:04 user nova-compute[76815]: INFO nova.compute.manager [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 22:40:04 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:40:04 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:40:05 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:40:05 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Took 0.84 seconds to deallocate network for instance.
Nov 14 22:40:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:05 user nova-compute[76815]: DEBUG nova.compute.manager [req-984fe0b0-de5b-49e5-a5a5-6ea4106fcc57 req-ffd0c029-148a-43af-8f52-f56788eac85f service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received event network-vif-deleted-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:40:05 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:40:05 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:40:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:06 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Deleted allocations for instance 2ced8c09-4383-4145-b939-1a0c730e10ca
Nov 14 22:40:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-50777347-6b25-43ea-b311-168fc4e84d62 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.124s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-ef651a82-eb0c-4ac2-86ee-e2016f4e9ed2 req-f25d2627-d04b-4274-9f40-1046a7766bec service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received event network-vif-plugged-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:40:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ef651a82-eb0c-4ac2-86ee-e2016f4e9ed2 req-f25d2627-d04b-4274-9f40-1046a7766bec service nova] Acquiring lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ef651a82-eb0c-4ac2-86ee-e2016f4e9ed2 req-f25d2627-d04b-4274-9f40-1046a7766bec service nova] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ef651a82-eb0c-4ac2-86ee-e2016f4e9ed2 req-f25d2627-d04b-4274-9f40-1046a7766bec service nova] Lock "2ced8c09-4383-4145-b939-1a0c730e10ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-ef651a82-eb0c-4ac2-86ee-e2016f4e9ed2 req-f25d2627-d04b-4274-9f40-1046a7766bec service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] No waiting events found dispatching network-vif-plugged-57ed7239-bd36-4571-89bb-e1d67d7103ac {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:40:06 user nova-compute[76815]: WARNING nova.compute.manager [req-ef651a82-eb0c-4ac2-86ee-e2016f4e9ed2 req-f25d2627-d04b-4274-9f40-1046a7766bec service nova] [instance: 2ced8c09-4383-4145-b939-1a0c730e10ca] Received unexpected event network-vif-plugged-57ed7239-bd36-4571-89bb-e1d67d7103ac for instance with vm_state deleted and task_state None.
Nov 14 22:40:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:40:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:40:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:40:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:40:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:40:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:40:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:40:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:40:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:56 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:40:56 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:40:56 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.03760528564453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:40:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 4726306c-2d1d-4395-af5c-bcb631d47e3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:57 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:40:57 user nova-compute[76815]: INFO nova.compute.claims [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Claim successful on node user
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:40:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.policy [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26aadea3a6964715be30b0fbb2c61c6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd690e5ff8584e2f9e24597816d90b98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:40:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Creating image(s)
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "/opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "/opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "/opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk 1073741824" returned: 0 in 0.052s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Successfully created port: 99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:40:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Cannot resize image /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Ensure instance console log exists: /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Successfully updated port: 99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "refresh_cache-939c4458-e3a3-4ec2-a2c2-465f3b1bba35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquired lock "refresh_cache-939c4458-e3a3-4ec2-a2c2-465f3b1bba35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.compute.manager [req-002da861-7f6b-4583-a728-87b033e286ff req-912bd00b-990c-4617-96ef-7ba8040eaf2c service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received event network-changed-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.compute.manager [req-002da861-7f6b-4583-a728-87b033e286ff req-912bd00b-990c-4617-96ef-7ba8040eaf2c service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Refreshing instance network info cache due to event network-changed-99bd9f8e-76a3-4f13-b5d6-95441772720e. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-002da861-7f6b-4583-a728-87b033e286ff req-912bd00b-990c-4617-96ef-7ba8040eaf2c service nova] Acquiring lock "refresh_cache-939c4458-e3a3-4ec2-a2c2-465f3b1bba35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.network.neutron [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Updating instance_info_cache with network_info: [{"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Releasing lock "refresh_cache-939c4458-e3a3-4ec2-a2c2-465f3b1bba35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Instance network_info: |[{"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-002da861-7f6b-4583-a728-87b033e286ff req-912bd00b-990c-4617-96ef-7ba8040eaf2c service nova] Acquired lock "refresh_cache-939c4458-e3a3-4ec2-a2c2-465f3b1bba35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.network.neutron [req-002da861-7f6b-4583-a728-87b033e286ff req-912bd00b-990c-4617-96ef-7ba8040eaf2c service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Refreshing network info cache for port 99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Start _get_guest_xml network_info=[{"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:40:59 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:40:59 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:40:59 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-505785802',display_name='tempest-AttachVolumeNegativeTest-server-505785802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-505785802',id=46,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACDkmid0J/qAixNsnfOpJT0C9LcIqEfEJtMOeiTfJ7jNFxPa5ELJ0p+bRcJ8UczfHKyhIg0EjSujHTQ+g75j51Kk1knzvr0glzO33YSWYhAADjF3P4feeevCaP0itxZWg==',key_name='tempest-keypair-962253964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-06kiee93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=939c4458-e3a3-4ec2-a2c2-465f3b1bba35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6f:f6,bridge_name='br-int',has_traffic_filtering=True,id=99bd9f8e-76a3-4f13-b5d6-95441772720e,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bd9f8e-76') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.objects.instance [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'pci_devices' on Instance uuid 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:41:00 user nova-compute[76815]:   <uuid>939c4458-e3a3-4ec2-a2c2-465f3b1bba35</uuid>
Nov 14 22:41:00 user nova-compute[76815]:   <name>instance-0000002e</name>
Nov 14 22:41:00 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:41:00 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:41:00 user nova-compute[76815]:   <metadata>
Nov 14 22:41:00 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:41:00 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:41:00 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeNegativeTest-server-505785802</nova:name>
Nov 14 22:41:00 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:40:59</nova:creationTime>
Nov 14 22:41:00 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:41:00 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:41:00 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:41:00 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:41:00 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:41:00 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:41:00 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:41:00 user nova-compute[76815]:       <nova:owner>
Nov 14 22:41:00 user nova-compute[76815]:         <nova:user uuid="26aadea3a6964715be30b0fbb2c61c6b">tempest-AttachVolumeNegativeTest-716641985-project-member</nova:user>
Nov 14 22:41:00 user nova-compute[76815]:         <nova:project uuid="fd690e5ff8584e2f9e24597816d90b98">tempest-AttachVolumeNegativeTest-716641985</nova:project>
Nov 14 22:41:00 user nova-compute[76815]:       </nova:owner>
Nov 14 22:41:00 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:41:00 user nova-compute[76815]:       <nova:ports>
Nov 14 22:41:00 user nova-compute[76815]:         <nova:port uuid="99bd9f8e-76a3-4f13-b5d6-95441772720e">
Nov 14 22:41:00 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 22:41:00 user nova-compute[76815]:         </nova:port>
Nov 14 22:41:00 user nova-compute[76815]:       </nova:ports>
Nov 14 22:41:00 user nova-compute[76815]:     </nova:instance>
Nov 14 22:41:00 user nova-compute[76815]:   </metadata>
Nov 14 22:41:00 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:41:00 user nova-compute[76815]:     <system>
Nov 14 22:41:00 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:41:00 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:41:00 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:41:00 user nova-compute[76815]:       <entry name="serial">939c4458-e3a3-4ec2-a2c2-465f3b1bba35</entry>
Nov 14 22:41:00 user nova-compute[76815]:       <entry name="uuid">939c4458-e3a3-4ec2-a2c2-465f3b1bba35</entry>
Nov 14 22:41:00 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:41:00 user nova-compute[76815]:     </system>
Nov 14 22:41:00 user nova-compute[76815]:   </sysinfo>
Nov 14 22:41:00 user nova-compute[76815]:   <os>
Nov 14 22:41:00 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:41:00 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:41:00 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:41:00 user nova-compute[76815]:   </os>
Nov 14 22:41:00 user nova-compute[76815]:   <features>
Nov 14 22:41:00 user nova-compute[76815]:     <acpi/>
Nov 14 22:41:00 user nova-compute[76815]:     <apic/>
Nov 14 22:41:00 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:41:00 user nova-compute[76815]:   </features>
Nov 14 22:41:00 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:41:00 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:41:00 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:41:00 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:41:00 user nova-compute[76815]:   </clock>
Nov 14 22:41:00 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:41:00 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:41:00 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:41:00 user nova-compute[76815]:   </cpu>
Nov 14 22:41:00 user nova-compute[76815]:   <devices>
Nov 14 22:41:00 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:41:00 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:41:00 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk"/>
Nov 14 22:41:00 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:41:00 user nova-compute[76815]:     </disk>
Nov 14 22:41:00 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:41:00 user nova-compute[76815]:       <mac address="fa:16:3e:5d:6f:f6"/>
Nov 14 22:41:00 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:41:00 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:41:00 user nova-compute[76815]:       <target dev="tap99bd9f8e-76"/>
Nov 14 22:41:00 user nova-compute[76815]:     </interface>
Nov 14 22:41:00 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:41:00 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/console.log" append="off"/>
Nov 14 22:41:00 user nova-compute[76815]:     </serial>
Nov 14 22:41:00 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:41:00 user nova-compute[76815]:     <video>
Nov 14 22:41:00 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:41:00 user nova-compute[76815]:     </video>
Nov 14 22:41:00 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:41:00 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:41:00 user nova-compute[76815]:     </rng>
Nov 14 22:41:00 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:41:00 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:41:00 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:41:00 user nova-compute[76815]:     </memballoon>
Nov 14 22:41:00 user nova-compute[76815]:   </devices>
Nov 14 22:41:00 user nova-compute[76815]: </domain>
Nov 14 22:41:00 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-505785802',display_name='tempest-AttachVolumeNegativeTest-server-505785802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-505785802',id=46,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACDkmid0J/qAixNsnfOpJT0C9LcIqEfEJtMOeiTfJ7jNFxPa5ELJ0p+bRcJ8UczfHKyhIg0EjSujHTQ+g75j51Kk1knzvr0glzO33YSWYhAADjF3P4feeevCaP0itxZWg==',key_name='tempest-keypair-962253964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-06kiee93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=939c4458-e3a3-4ec2-a2c2-465f3b1bba35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6f:f6,bridge_name='br-int',has_traffic_filtering=True,id=99bd9f8e-76a3-4f13-b5d6-95441772720e,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bd9f8e-76') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG os_vif [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6f:f6,bridge_name='br-int',has_traffic_filtering=True,id=99bd9f8e-76a3-4f13-b5d6-95441772720e,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bd9f8e-76') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1af1875-4ad4-5729-8115-2211295023ee', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99bd9f8e-76, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99bd9f8e-76, col_values=(('qos', UUID('4a00b9dc-df4b-4daa-83eb-408aa2f06d3d')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99bd9f8e-76, col_values=(('external_ids', {'iface-id': '99bd9f8e-76a3-4f13-b5d6-95441772720e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:6f:f6', 'vm-uuid': '939c4458-e3a3-4ec2-a2c2-465f3b1bba35'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:00 user nova-compute[76815]: INFO os_vif [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:6f:f6,bridge_name='br-int',has_traffic_filtering=True,id=99bd9f8e-76a3-4f13-b5d6-95441772720e,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bd9f8e-76')
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No VIF found with MAC fa:16:3e:5d:6f:f6, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.network.neutron [req-002da861-7f6b-4583-a728-87b033e286ff req-912bd00b-990c-4617-96ef-7ba8040eaf2c service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Updated VIF entry in instance network info cache for port 99bd9f8e-76a3-4f13-b5d6-95441772720e. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG nova.network.neutron [req-002da861-7f6b-4583-a728-87b033e286ff req-912bd00b-990c-4617-96ef-7ba8040eaf2c service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Updating instance_info_cache with network_info: [{"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:41:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-002da861-7f6b-4583-a728-87b033e286ff req-912bd00b-990c-4617-96ef-7ba8040eaf2c service nova] Releasing lock "refresh_cache-939c4458-e3a3-4ec2-a2c2-465f3b1bba35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG nova.compute.manager [req-ffeb18e3-f8e0-41b2-8f85-491591889c10 req-6d585f15-3a99-4907-b138-094d7ce52a3c service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received event network-vif-plugged-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ffeb18e3-f8e0-41b2-8f85-491591889c10 req-6d585f15-3a99-4907-b138-094d7ce52a3c service nova] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ffeb18e3-f8e0-41b2-8f85-491591889c10 req-6d585f15-3a99-4907-b138-094d7ce52a3c service nova] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ffeb18e3-f8e0-41b2-8f85-491591889c10 req-6d585f15-3a99-4907-b138-094d7ce52a3c service nova] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG nova.compute.manager [req-ffeb18e3-f8e0-41b2-8f85-491591889c10 req-6d585f15-3a99-4907-b138-094d7ce52a3c service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] No waiting events found dispatching network-vif-plugged-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:41:01 user nova-compute[76815]: WARNING nova.compute.manager [req-ffeb18e3-f8e0-41b2-8f85-491591889c10 req-6d585f15-3a99-4907-b138-094d7ce52a3c service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received unexpected event network-vif-plugged-99bd9f8e-76a3-4f13-b5d6-95441772720e for instance with vm_state building and task_state spawning.
Nov 14 22:41:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:41:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Instance spawned successfully.
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:03 user nova-compute[76815]: INFO nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-22e97a58-9eeb-4c2f-9769-ae006c6c4fc1 req-0ff213ed-ffc9-4b85-a5e7-2938c521dd87 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received event network-vif-plugged-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22e97a58-9eeb-4c2f-9769-ae006c6c4fc1 req-0ff213ed-ffc9-4b85-a5e7-2938c521dd87 service nova] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22e97a58-9eeb-4c2f-9769-ae006c6c4fc1 req-0ff213ed-ffc9-4b85-a5e7-2938c521dd87 service nova] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-22e97a58-9eeb-4c2f-9769-ae006c6c4fc1 req-0ff213ed-ffc9-4b85-a5e7-2938c521dd87 service nova] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-22e97a58-9eeb-4c2f-9769-ae006c6c4fc1 req-0ff213ed-ffc9-4b85-a5e7-2938c521dd87 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] No waiting events found dispatching network-vif-plugged-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:41:03 user nova-compute[76815]: WARNING nova.compute.manager [req-22e97a58-9eeb-4c2f-9769-ae006c6c4fc1 req-0ff213ed-ffc9-4b85-a5e7-2938c521dd87 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received unexpected event network-vif-plugged-99bd9f8e-76a3-4f13-b5d6-95441772720e for instance with vm_state building and task_state spawning.
Nov 14 22:41:03 user nova-compute[76815]: INFO nova.compute.manager [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Took 5.97 seconds to build instance.
Nov 14 22:41:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ac0015e2-9d71-40b3-b820-bcb61e62263a tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.064s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:41:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:09 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:41:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:19 user nova-compute[76815]: INFO nova.compute.manager [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Terminating instance
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-b5474997-7b82-476d-a295-f9f472d94959 req-598b96b9-807d-4c6e-ac55-1cccddae36b9 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-unplugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b5474997-7b82-476d-a295-f9f472d94959 req-598b96b9-807d-4c6e-ac55-1cccddae36b9 service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b5474997-7b82-476d-a295-f9f472d94959 req-598b96b9-807d-4c6e-ac55-1cccddae36b9 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b5474997-7b82-476d-a295-f9f472d94959 req-598b96b9-807d-4c6e-ac55-1cccddae36b9 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-b5474997-7b82-476d-a295-f9f472d94959 req-598b96b9-807d-4c6e-ac55-1cccddae36b9 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-unplugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-b5474997-7b82-476d-a295-f9f472d94959 req-598b96b9-807d-4c6e-ac55-1cccddae36b9 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-unplugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:41:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Instance destroyed successfully.
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.objects.instance [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'resources' on Instance uuid 4726306c-2d1d-4395-af5c-bcb631d47e3a {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:31:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-88532880',display_name='tempest-AttachVolumeTestJSON-server-88532880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-88532880',id=41,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQubaL4MRQuzJoCVwamFoNIlvVZWcGCwACqD1aiy1LaEn8qAs7tkZ5TTctrQdfL2x8ZstSYKMLnmOAaQmEsNBAZvuRmZsqzswxqjPsbJlZXq1ikUWRFm/k6lX6ZPoGyzg==',key_name='tempest-keypair-2014797013',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:31:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-436ixbo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=4726306c-2d1d-4395-af5c-bcb631d47e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "address": "fa:16:3e:c4:49:e2", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc05760-8b", "ovs_interfaceid": "ecc05760-8b9f-47c6-aa52-6ada01978b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG os_vif [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecc05760-8b, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2841d0f9-5a53-4aaa-90b1-83921aca5951) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:41:19 user nova-compute[76815]: INFO os_vif [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:49:e2,bridge_name='br-int',has_traffic_filtering=True,id=ecc05760-8b9f-47c6-aa52-6ada01978b59,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc05760-8b')
Nov 14 22:41:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Deleting instance files /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a_del
Nov 14 22:41:19 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Deletion of /opt/stack/data/nova/instances/4726306c-2d1d-4395-af5c-bcb631d47e3a_del complete
Nov 14 22:41:19 user nova-compute[76815]: INFO nova.compute.manager [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 14 22:41:19 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:41:19 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:41:20 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:41:20 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Took 0.74 seconds to deallocate network for instance.
Nov 14 22:41:20 user nova-compute[76815]: DEBUG nova.compute.manager [req-c10af15d-46bc-447c-a00c-9a8a5a74f468 req-172a35dc-9046-4879-92d3-f5d8119fe60d service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-deleted-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:41:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:20 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:41:20 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:41:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:20 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Deleted allocations for instance 4726306c-2d1d-4395-af5c-bcb631d47e3a
Nov 14 22:41:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-dda1eaee-8c30-49d0-a3a9-2d49bc4c1ea6 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-61140cc9-644b-41bd-9fee-2101ead0b836 req-9e4fc83f-a629-480c-ba8a-536f7f9a50e9 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:41:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-61140cc9-644b-41bd-9fee-2101ead0b836 req-9e4fc83f-a629-480c-ba8a-536f7f9a50e9 service nova] Acquiring lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-61140cc9-644b-41bd-9fee-2101ead0b836 req-9e4fc83f-a629-480c-ba8a-536f7f9a50e9 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-61140cc9-644b-41bd-9fee-2101ead0b836 req-9e4fc83f-a629-480c-ba8a-536f7f9a50e9 service nova] Lock "4726306c-2d1d-4395-af5c-bcb631d47e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-61140cc9-644b-41bd-9fee-2101ead0b836 req-9e4fc83f-a629-480c-ba8a-536f7f9a50e9 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] No waiting events found dispatching network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:41:21 user nova-compute[76815]: WARNING nova.compute.manager [req-61140cc9-644b-41bd-9fee-2101ead0b836 req-9e4fc83f-a629-480c-ba8a-536f7f9a50e9 service nova] [instance: 4726306c-2d1d-4395-af5c-bcb631d47e3a] Received unexpected event network-vif-plugged-ecc05760-8b9f-47c6-aa52-6ada01978b59 for instance with vm_state deleted and task_state None.
Nov 14 22:41:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:41:32 user nova-compute[76815]: INFO nova.compute.claims [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Claim successful on node user
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:41:32 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.policy [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7726302e74c45ba94acea58ff3ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b06ff4e376e9419babeacd8a4d586574', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:41:32 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Creating image(s)
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:32 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk 1073741824" returned: 0 in 0.057s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Successfully created port: 35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Cannot resize image /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Ensure instance console log exists: /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:33 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Successfully updated port: 35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquired lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-3eb7b8fa-b027-4665-91a5-3f471bdf3577 req-8435eb38-522e-4a4d-a944-77b8f74d780e service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-changed-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-3eb7b8fa-b027-4665-91a5-3f471bdf3577 req-8435eb38-522e-4a4d-a944-77b8f74d780e service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Refreshing instance network info cache due to event network-changed-35df3788-4c76-4df0-b7f2-ae06436f800d. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3eb7b8fa-b027-4665-91a5-3f471bdf3577 req-8435eb38-522e-4a4d-a944-77b8f74d780e service nova] Acquiring lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Releasing lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Instance network_info: |[{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3eb7b8fa-b027-4665-91a5-3f471bdf3577 req-8435eb38-522e-4a4d-a944-77b8f74d780e service nova] Acquired lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-3eb7b8fa-b027-4665-91a5-3f471bdf3577 req-8435eb38-522e-4a4d-a944-77b8f74d780e service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Refreshing network info cache for port 35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Start _get_guest_xml network_info=[{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:41:34 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:41:34 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1301907907',display_name='tempest-ServerRescueNegativeTestJSON-server-1301907907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1301907907',id=47,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGWgPVNwI8DhuqwOjdohDACPc5+dcRRRpmNT48qpO7BhRQxWDcHA5eWe6UINmc1InAGk07XfG40k/ye14BWaCMwLoGZfZ3e32c8lwL2fWVdFf5fPoiTEe2PWh+/kGb6Kg==',key_name='tempest-keypair-1284410080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-35oa0v8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=cb981494-6911-4ae9-a88b-3770d7b05049,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:60:80,bridge_name='br-int',has_traffic_filtering=True,id=35df3788-4c76-4df0-b7f2-ae06436f800d,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35df3788-4c') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'pci_devices' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:41:34 user nova-compute[76815]:   <uuid>cb981494-6911-4ae9-a88b-3770d7b05049</uuid>
Nov 14 22:41:34 user nova-compute[76815]:   <name>instance-0000002f</name>
Nov 14 22:41:34 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:41:34 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:41:34 user nova-compute[76815]:   <metadata>
Nov 14 22:41:34 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:41:34 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:41:34 user nova-compute[76815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1301907907</nova:name>
Nov 14 22:41:34 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:41:34</nova:creationTime>
Nov 14 22:41:34 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:41:34 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:41:34 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:41:34 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:41:34 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:41:34 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:41:34 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:41:34 user nova-compute[76815]:       <nova:owner>
Nov 14 22:41:34 user nova-compute[76815]:         <nova:user uuid="d7726302e74c45ba94acea58ff3ca7c6">tempest-ServerRescueNegativeTestJSON-1323022133-project-member</nova:user>
Nov 14 22:41:34 user nova-compute[76815]:         <nova:project uuid="b06ff4e376e9419babeacd8a4d586574">tempest-ServerRescueNegativeTestJSON-1323022133</nova:project>
Nov 14 22:41:34 user nova-compute[76815]:       </nova:owner>
Nov 14 22:41:34 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:41:34 user nova-compute[76815]:       <nova:ports>
Nov 14 22:41:34 user nova-compute[76815]:         <nova:port uuid="35df3788-4c76-4df0-b7f2-ae06436f800d">
Nov 14 22:41:34 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:41:34 user nova-compute[76815]:         </nova:port>
Nov 14 22:41:34 user nova-compute[76815]:       </nova:ports>
Nov 14 22:41:34 user nova-compute[76815]:     </nova:instance>
Nov 14 22:41:34 user nova-compute[76815]:   </metadata>
Nov 14 22:41:34 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:41:34 user nova-compute[76815]:     <system>
Nov 14 22:41:34 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:41:34 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:41:34 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:41:34 user nova-compute[76815]:       <entry name="serial">cb981494-6911-4ae9-a88b-3770d7b05049</entry>
Nov 14 22:41:34 user nova-compute[76815]:       <entry name="uuid">cb981494-6911-4ae9-a88b-3770d7b05049</entry>
Nov 14 22:41:34 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:41:34 user nova-compute[76815]:     </system>
Nov 14 22:41:34 user nova-compute[76815]:   </sysinfo>
Nov 14 22:41:34 user nova-compute[76815]:   <os>
Nov 14 22:41:34 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:41:34 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:41:34 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:41:34 user nova-compute[76815]:   </os>
Nov 14 22:41:34 user nova-compute[76815]:   <features>
Nov 14 22:41:34 user nova-compute[76815]:     <acpi/>
Nov 14 22:41:34 user nova-compute[76815]:     <apic/>
Nov 14 22:41:34 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:41:34 user nova-compute[76815]:   </features>
Nov 14 22:41:34 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:41:34 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:41:34 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:41:34 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:41:34 user nova-compute[76815]:   </clock>
Nov 14 22:41:34 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:41:34 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:41:34 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:41:34 user nova-compute[76815]:   </cpu>
Nov 14 22:41:34 user nova-compute[76815]:   <devices>
Nov 14 22:41:34 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:41:34 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:41:34 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk"/>
Nov 14 22:41:34 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:41:34 user nova-compute[76815]:     </disk>
Nov 14 22:41:34 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:41:34 user nova-compute[76815]:       <mac address="fa:16:3e:1b:60:80"/>
Nov 14 22:41:34 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:41:34 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:41:34 user nova-compute[76815]:       <target dev="tap35df3788-4c"/>
Nov 14 22:41:34 user nova-compute[76815]:     </interface>
Nov 14 22:41:34 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:41:34 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/console.log" append="off"/>
Nov 14 22:41:34 user nova-compute[76815]:     </serial>
Nov 14 22:41:34 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:41:34 user nova-compute[76815]:     <video>
Nov 14 22:41:34 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:41:34 user nova-compute[76815]:     </video>
Nov 14 22:41:34 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:41:34 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:41:34 user nova-compute[76815]:     </rng>
Nov 14 22:41:34 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:41:34 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:41:34 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:41:34 user nova-compute[76815]:     </memballoon>
Nov 14 22:41:34 user nova-compute[76815]:   </devices>
Nov 14 22:41:34 user nova-compute[76815]: </domain>
Nov 14 22:41:34 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1301907907',display_name='tempest-ServerRescueNegativeTestJSON-server-1301907907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1301907907',id=47,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGWgPVNwI8DhuqwOjdohDACPc5+dcRRRpmNT48qpO7BhRQxWDcHA5eWe6UINmc1InAGk07XfG40k/ye14BWaCMwLoGZfZ3e32c8lwL2fWVdFf5fPoiTEe2PWh+/kGb6Kg==',key_name='tempest-keypair-1284410080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-35oa0v8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=cb981494-6911-4ae9-a88b-3770d7b05049,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:60:80,bridge_name='br-int',has_traffic_filtering=True,id=35df3788-4c76-4df0-b7f2-ae06436f800d,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35df3788-4c') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG os_vif [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:60:80,bridge_name='br-int',has_traffic_filtering=True,id=35df3788-4c76-4df0-b7f2-ae06436f800d,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35df3788-4c') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00e4d25e-e168-5f22-98fc-51cda3111027', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35df3788-4c, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35df3788-4c, col_values=(('qos', UUID('3168ac24-be93-463e-b233-01d6a16f0e4a')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35df3788-4c, col_values=(('external_ids', {'iface-id': '35df3788-4c76-4df0-b7f2-ae06436f800d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:60:80', 'vm-uuid': 'cb981494-6911-4ae9-a88b-3770d7b05049'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:34 user nova-compute[76815]: INFO os_vif [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:60:80,bridge_name='br-int',has_traffic_filtering=True,id=35df3788-4c76-4df0-b7f2-ae06436f800d,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35df3788-4c')
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No VIF found with MAC fa:16:3e:1b:60:80, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-3eb7b8fa-b027-4665-91a5-3f471bdf3577 req-8435eb38-522e-4a4d-a944-77b8f74d780e service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updated VIF entry in instance network info cache for port 35df3788-4c76-4df0-b7f2-ae06436f800d. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-3eb7b8fa-b027-4665-91a5-3f471bdf3577 req-8435eb38-522e-4a4d-a944-77b8f74d780e service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:41:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3eb7b8fa-b027-4665-91a5-3f471bdf3577 req-8435eb38-522e-4a4d-a944-77b8f74d780e service nova] Releasing lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:41:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-52dece12-a9f3-4f3d-aa6f-8ece8ec72d8b req-5f417540-3413-4ad9-b312-b5c19c4f5a8f service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:41:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-52dece12-a9f3-4f3d-aa6f-8ece8ec72d8b req-5f417540-3413-4ad9-b312-b5c19c4f5a8f service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-52dece12-a9f3-4f3d-aa6f-8ece8ec72d8b req-5f417540-3413-4ad9-b312-b5c19c4f5a8f service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-52dece12-a9f3-4f3d-aa6f-8ece8ec72d8b req-5f417540-3413-4ad9-b312-b5c19c4f5a8f service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-52dece12-a9f3-4f3d-aa6f-8ece8ec72d8b req-5f417540-3413-4ad9-b312-b5c19c4f5a8f service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:41:35 user nova-compute[76815]: WARNING nova.compute.manager [req-52dece12-a9f3-4f3d-aa6f-8ece8ec72d8b req-5f417540-3413-4ad9-b312-b5c19c4f5a8f service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state building and task_state spawning.
Nov 14 22:41:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:41:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Instance spawned successfully.
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:41:37 user nova-compute[76815]: INFO nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-a7318c56-7805-4836-a881-17adbfe848f9 req-8c272f5e-81e4-4ec3-9581-82308bbeb3d2 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a7318c56-7805-4836-a881-17adbfe848f9 req-8c272f5e-81e4-4ec3-9581-82308bbeb3d2 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a7318c56-7805-4836-a881-17adbfe848f9 req-8c272f5e-81e4-4ec3-9581-82308bbeb3d2 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a7318c56-7805-4836-a881-17adbfe848f9 req-8c272f5e-81e4-4ec3-9581-82308bbeb3d2 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:37 user nova-compute[76815]: DEBUG nova.compute.manager [req-a7318c56-7805-4836-a881-17adbfe848f9 req-8c272f5e-81e4-4ec3-9581-82308bbeb3d2 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:41:37 user nova-compute[76815]: WARNING nova.compute.manager [req-a7318c56-7805-4836-a881-17adbfe848f9 req-8c272f5e-81e4-4ec3-9581-82308bbeb3d2 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state active and task_state None.
Nov 14 22:41:37 user nova-compute[76815]: INFO nova.compute.manager [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Took 5.83 seconds to build instance.
Nov 14 22:41:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0ed307e0-eeb3-421f-8cca-f9722e72ed3b tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.930s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:41:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:41:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:41:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:41:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:41:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:41:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:41:57 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:41:57 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8535MB free_disk=25.008617401123047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance cb981494-6911-4ae9-a88b-3770d7b05049 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:41:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:41:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:00 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:00 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:00 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:42:00 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:42:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:42:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:42:00 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:42:00 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:42:01 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:42:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:42:01 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:42:01 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:01 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:01 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:01 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:42:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:42:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:12 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:42:12 user nova-compute[76815]: INFO nova.compute.claims [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Claim successful on node user
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.network.neutron [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:42:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:42:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Creating image(s)
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "/opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "/opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "/opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.policy [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3590183279e742f0bced96008d784cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e13ac882a01d4abfa130458292b5cd40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk 1073741824" returned: 0 in 0.049s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:42:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Cannot resize image /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Ensure instance console log exists: /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Successfully created port: 959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Successfully updated port: 959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "refresh_cache-729a56a3-cad3-4b94-9f45-ecf919f955d6" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquired lock "refresh_cache-729a56a3-cad3-4b94-9f45-ecf919f955d6" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-758043c0-0970-4e12-b895-bfaceaea64c8 req-c12e725d-2091-43f7-9702-34c2183840c6 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received event network-changed-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-758043c0-0970-4e12-b895-bfaceaea64c8 req-c12e725d-2091-43f7-9702-34c2183840c6 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Refreshing instance network info cache due to event network-changed-959b3839-b291-4645-a12f-24e657e89e62. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-758043c0-0970-4e12-b895-bfaceaea64c8 req-c12e725d-2091-43f7-9702-34c2183840c6 service nova] Acquiring lock "refresh_cache-729a56a3-cad3-4b94-9f45-ecf919f955d6" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:42:14 user nova-compute[76815]: DEBUG nova.network.neutron [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Updating instance_info_cache with network_info: [{"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Releasing lock "refresh_cache-729a56a3-cad3-4b94-9f45-ecf919f955d6" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Instance network_info: |[{"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-758043c0-0970-4e12-b895-bfaceaea64c8 req-c12e725d-2091-43f7-9702-34c2183840c6 service nova] Acquired lock "refresh_cache-729a56a3-cad3-4b94-9f45-ecf919f955d6" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-758043c0-0970-4e12-b895-bfaceaea64c8 req-c12e725d-2091-43f7-9702-34c2183840c6 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Refreshing network info cache for port 959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Start _get_guest_xml network_info=[{"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:42:15 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:42:15 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-615020152',display_name='tempest-AttachVolumeTestJSON-server-615020152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-615020152',id=48,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+1K8SCsObrOlb2JU0m3K2wHq8p9vD04F/S+dJlr4IFVnJLUGIXOYT5HwGvNkshSoj/0cpLIMEnDxMSOY603aOdKUJnavkpTCepTD7oejNvUOdgaxcPfvnp11u4ZqpgmQ==',key_name='tempest-keypair-712419283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-t0n5q470',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:42:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=729a56a3-cad3-4b94-9f45-ecf919f955d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:09:24,bridge_name='br-int',has_traffic_filtering=True,id=959b3839-b291-4645-a12f-24e657e89e62,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap959b3839-b2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.objects.instance [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'pci_devices' on Instance uuid 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:42:15 user nova-compute[76815]:   <uuid>729a56a3-cad3-4b94-9f45-ecf919f955d6</uuid>
Nov 14 22:42:15 user nova-compute[76815]:   <name>instance-00000030</name>
Nov 14 22:42:15 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:42:15 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:42:15 user nova-compute[76815]:   <metadata>
Nov 14 22:42:15 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:42:15 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:42:15 user nova-compute[76815]:       <nova:name>tempest-AttachVolumeTestJSON-server-615020152</nova:name>
Nov 14 22:42:15 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:42:15</nova:creationTime>
Nov 14 22:42:15 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:42:15 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:42:15 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:42:15 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:42:15 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:42:15 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:42:15 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:42:15 user nova-compute[76815]:       <nova:owner>
Nov 14 22:42:15 user nova-compute[76815]:         <nova:user uuid="3590183279e742f0bced96008d784cfb">tempest-AttachVolumeTestJSON-252609817-project-member</nova:user>
Nov 14 22:42:15 user nova-compute[76815]:         <nova:project uuid="e13ac882a01d4abfa130458292b5cd40">tempest-AttachVolumeTestJSON-252609817</nova:project>
Nov 14 22:42:15 user nova-compute[76815]:       </nova:owner>
Nov 14 22:42:15 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:42:15 user nova-compute[76815]:       <nova:ports>
Nov 14 22:42:15 user nova-compute[76815]:         <nova:port uuid="959b3839-b291-4645-a12f-24e657e89e62">
Nov 14 22:42:15 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 22:42:15 user nova-compute[76815]:         </nova:port>
Nov 14 22:42:15 user nova-compute[76815]:       </nova:ports>
Nov 14 22:42:15 user nova-compute[76815]:     </nova:instance>
Nov 14 22:42:15 user nova-compute[76815]:   </metadata>
Nov 14 22:42:15 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:42:15 user nova-compute[76815]:     <system>
Nov 14 22:42:15 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:42:15 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:42:15 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:42:15 user nova-compute[76815]:       <entry name="serial">729a56a3-cad3-4b94-9f45-ecf919f955d6</entry>
Nov 14 22:42:15 user nova-compute[76815]:       <entry name="uuid">729a56a3-cad3-4b94-9f45-ecf919f955d6</entry>
Nov 14 22:42:15 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:42:15 user nova-compute[76815]:     </system>
Nov 14 22:42:15 user nova-compute[76815]:   </sysinfo>
Nov 14 22:42:15 user nova-compute[76815]:   <os>
Nov 14 22:42:15 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:42:15 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:42:15 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:42:15 user nova-compute[76815]:   </os>
Nov 14 22:42:15 user nova-compute[76815]:   <features>
Nov 14 22:42:15 user nova-compute[76815]:     <acpi/>
Nov 14 22:42:15 user nova-compute[76815]:     <apic/>
Nov 14 22:42:15 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:42:15 user nova-compute[76815]:   </features>
Nov 14 22:42:15 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:42:15 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:42:15 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:42:15 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:42:15 user nova-compute[76815]:   </clock>
Nov 14 22:42:15 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:42:15 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:42:15 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:42:15 user nova-compute[76815]:   </cpu>
Nov 14 22:42:15 user nova-compute[76815]:   <devices>
Nov 14 22:42:15 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:42:15 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:42:15 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk"/>
Nov 14 22:42:15 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:42:15 user nova-compute[76815]:     </disk>
Nov 14 22:42:15 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:42:15 user nova-compute[76815]:       <mac address="fa:16:3e:42:09:24"/>
Nov 14 22:42:15 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:42:15 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:42:15 user nova-compute[76815]:       <target dev="tap959b3839-b2"/>
Nov 14 22:42:15 user nova-compute[76815]:     </interface>
Nov 14 22:42:15 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:42:15 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/console.log" append="off"/>
Nov 14 22:42:15 user nova-compute[76815]:     </serial>
Nov 14 22:42:15 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:42:15 user nova-compute[76815]:     <video>
Nov 14 22:42:15 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:42:15 user nova-compute[76815]:     </video>
Nov 14 22:42:15 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:42:15 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:42:15 user nova-compute[76815]:     </rng>
Nov 14 22:42:15 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:42:15 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:42:15 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:42:15 user nova-compute[76815]:     </memballoon>
Nov 14 22:42:15 user nova-compute[76815]:   </devices>
Nov 14 22:42:15 user nova-compute[76815]: </domain>
Nov 14 22:42:15 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-615020152',display_name='tempest-AttachVolumeTestJSON-server-615020152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-615020152',id=48,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+1K8SCsObrOlb2JU0m3K2wHq8p9vD04F/S+dJlr4IFVnJLUGIXOYT5HwGvNkshSoj/0cpLIMEnDxMSOY603aOdKUJnavkpTCepTD7oejNvUOdgaxcPfvnp11u4ZqpgmQ==',key_name='tempest-keypair-712419283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-t0n5q470',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:42:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=729a56a3-cad3-4b94-9f45-ecf919f955d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:09:24,bridge_name='br-int',has_traffic_filtering=True,id=959b3839-b291-4645-a12f-24e657e89e62,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap959b3839-b2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG os_vif [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:09:24,bridge_name='br-int',has_traffic_filtering=True,id=959b3839-b291-4645-a12f-24e657e89e62,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap959b3839-b2') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ca35ef4-ee8a-5de0-9d7d-fa604eb7fed3', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap959b3839-b2, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap959b3839-b2, col_values=(('qos', UUID('d8086757-a732-4df6-afce-45d32959d4a3')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap959b3839-b2, col_values=(('external_ids', {'iface-id': '959b3839-b291-4645-a12f-24e657e89e62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:09:24', 'vm-uuid': '729a56a3-cad3-4b94-9f45-ecf919f955d6'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:15 user nova-compute[76815]: INFO os_vif [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:09:24,bridge_name='br-int',has_traffic_filtering=True,id=959b3839-b291-4645-a12f-24e657e89e62,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap959b3839-b2')
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No VIF found with MAC fa:16:3e:42:09:24, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-758043c0-0970-4e12-b895-bfaceaea64c8 req-c12e725d-2091-43f7-9702-34c2183840c6 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Updated VIF entry in instance network info cache for port 959b3839-b291-4645-a12f-24e657e89e62. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-758043c0-0970-4e12-b895-bfaceaea64c8 req-c12e725d-2091-43f7-9702-34c2183840c6 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Updating instance_info_cache with network_info: [{"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:42:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-758043c0-0970-4e12-b895-bfaceaea64c8 req-c12e725d-2091-43f7-9702-34c2183840c6 service nova] Releasing lock "refresh_cache-729a56a3-cad3-4b94-9f45-ecf919f955d6" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:42:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received event network-vif-plugged-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] No waiting events found dispatching network-vif-plugged-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:42:17 user nova-compute[76815]: WARNING nova.compute.manager [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received unexpected event network-vif-plugged-959b3839-b291-4645-a12f-24e657e89e62 for instance with vm_state building and task_state spawning.
Nov 14 22:42:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received event network-vif-plugged-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] No waiting events found dispatching network-vif-plugged-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:42:17 user nova-compute[76815]: WARNING nova.compute.manager [req-e24c6bf9-6e4b-40e5-be0e-8bc23e776124 req-3852fb66-9f7e-429c-8025-860af1d36297 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received unexpected event network-vif-plugged-959b3839-b291-4645-a12f-24e657e89e62 for instance with vm_state building and task_state spawning.
Nov 14 22:42:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:42:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Instance spawned successfully.
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:42:18 user nova-compute[76815]: INFO nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 14 22:42:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:42:18 user nova-compute[76815]: INFO nova.compute.manager [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Took 6.21 seconds to build instance.
Nov 14 22:42:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-34dd9c61-bd55-435b-8a97-393d06d82b07 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.306s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:22 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-1c3614ec-b7e9-4948-9146-aebbdfa2b01c req-18c0bd88-d10e-4b23-ab7e-9d0409b046d7 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received event network-changed-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:42:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-1c3614ec-b7e9-4948-9146-aebbdfa2b01c req-18c0bd88-d10e-4b23-ab7e-9d0409b046d7 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Refreshing instance network info cache due to event network-changed-99bd9f8e-76a3-4f13-b5d6-95441772720e. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:42:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c3614ec-b7e9-4948-9146-aebbdfa2b01c req-18c0bd88-d10e-4b23-ab7e-9d0409b046d7 service nova] Acquiring lock "refresh_cache-939c4458-e3a3-4ec2-a2c2-465f3b1bba35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:42:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c3614ec-b7e9-4948-9146-aebbdfa2b01c req-18c0bd88-d10e-4b23-ab7e-9d0409b046d7 service nova] Acquired lock "refresh_cache-939c4458-e3a3-4ec2-a2c2-465f3b1bba35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:42:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c3614ec-b7e9-4948-9146-aebbdfa2b01c req-18c0bd88-d10e-4b23-ab7e-9d0409b046d7 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Refreshing network info cache for port 99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:42:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c3614ec-b7e9-4948-9146-aebbdfa2b01c req-18c0bd88-d10e-4b23-ab7e-9d0409b046d7 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Updated VIF entry in instance network info cache for port 99bd9f8e-76a3-4f13-b5d6-95441772720e. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:42:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-1c3614ec-b7e9-4948-9146-aebbdfa2b01c req-18c0bd88-d10e-4b23-ab7e-9d0409b046d7 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Updating instance_info_cache with network_info: [{"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:42:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1c3614ec-b7e9-4948-9146-aebbdfa2b01c req-18c0bd88-d10e-4b23-ab7e-9d0409b046d7 service nova] Releasing lock "refresh_cache-939c4458-e3a3-4ec2-a2c2-465f3b1bba35" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'flavor' on Instance uuid 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:50 user nova-compute[76815]: INFO nova.compute.manager [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Attaching volume 0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 to /dev/vdb
Nov 14 22:42:50 user nova-compute[76815]: DEBUG os_brick.utils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efff1ba-1436-432f-8730-b604d67d5b68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6b16a5-6ced-4400-9258-e7a5ecddb8e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f353a9b4-719e-47b1-9d8c-e702a2d2c392]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72717c63-e4fe-4dbb-9e1f-b0de4312180c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:42:50 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:42:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e97b08c-c799-44cb-826f-b4fe0b2ce309]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG os_brick.utils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:42:50 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Updating existing volume attachment record: 1ed37784-aab3-4545-8462-37f535a899d1 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:42:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obOWzvte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:42:54 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:42:54 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:42:54 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90d27e1-baaa-4a5c-9e9d-04d7df25727f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:42:54 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b26c5ad-1eac-4c19-9ed6-66e12ff62584]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9] added
Nov 14 22:42:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[571987f0-4f88-43bb-9b99-c3cc6c2fecb1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8590e3-eb10-44c3-a4ac-781df342bf89]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v obOWzvte {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v obOWzvte" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e188f-b9cc-4da7-abb2-792bbb5d3c16]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'obOWzvte'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2024239f-a4d7-4347-a268-2730c28baf8b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5de0be-0656-48f9-93b7-12b3a94bab5f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:42:54 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:42:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:42:54 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:42:54 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:42:54 user nova-compute[76815]: 
Nov 14 22:42:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d237f572-811d-4d45-8d06-89946deedb8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9, portal: 172.16.0.220,3260]
Nov 14 22:42:55 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9, portal: 172.16.0.220,3260] successful.
Nov 14 22:42:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf51262-ffa6-4544-ab57-bcbd3166dcf7]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b739db10-93cb-447d-986b-ed6d3972e6dc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 (non-flash)
Nov 14 22:42:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 (non-flash)
Nov 14 22:42:55 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[db756ded-b411-4d21-b85f-174e1ed2a667]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:42:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obOWzvte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23961366662333334', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961366662333334', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'flavor' on Instance uuid 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:42:56 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:42:56 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:42:56 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:42:56 user nova-compute[76815]:   <serial>0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9</serial>
Nov 14 22:42:56 user nova-compute[76815]: </disk>
Nov 14 22:42:56 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] No VIF found with MAC fa:16:3e:5d:6f:f6, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:42:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0e52629f-83c6-4a85-b908-a9478d87db87 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.383s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:57 user nova-compute[76815]: INFO nova.compute.manager [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Detaching volume 0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9
Nov 14 22:42:57 user nova-compute[76815]: INFO nova.virt.block_device [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Attempting to driver detach volume 0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 from mountpoint /dev/vdb
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Attempting to detach device vdb from instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:42:57 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:42:57 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:42:57 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:42:57 user nova-compute[76815]:   <serial>0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9</serial>
Nov 14 22:42:57 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:42:57 user nova-compute[76815]: </disk>
Nov 14 22:42:57 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:42:57 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully detached device vdb from instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 from the persistent domain config.
Nov 14 22:42:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:42:57 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:42:57 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:42:57 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:42:57 user nova-compute[76815]:   <serial>0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9</serial>
Nov 14 22:42:57 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:42:57 user nova-compute[76815]: </disk>
Nov 14 22:42:57 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:42:59 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:42:59 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:42:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=24.961071014404297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance cb981494-6911-4ae9-a88b-3770d7b05049 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:42:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:43:00 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:43:00 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:43:00 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:43:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updating instance_info_cache with network_info: [{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:43:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:43:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:43:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:43:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:43:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:43:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:17 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 is timed out.
Nov 14 22:43:17 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully detached device vdb from instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 from the live domain config.
Nov 14 22:43:17 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'obOWzvte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:43:17 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5a3a22-5314-40dc-8e71-76105981ea0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:43:17 user nova-compute[76815]: No targets found.
Nov 14 22:43:17 user nova-compute[76815]: iSNS:
Nov 14 22:43:17 user nova-compute[76815]: No targets found.
Nov 14 22:43:17 user nova-compute[76815]: STATIC:
Nov 14 22:43:17 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9
Nov 14 22:43:17 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:43:17 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:43:17 user nova-compute[76815]: FIRMWARE:
Nov 14 22:43:17 user nova-compute[76815]: No targets found.
Nov 14 22:43:17 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:43:17 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:43:17 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ad3a36-9142-46e6-bf79-b34cb5fb9139]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0d9a9-15d0-4738-a768-c2a167f75a14]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 (non-flash)
Nov 14 22:43:17 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 (non-flash)
Nov 14 22:43:17 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74d1233d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74fd158-ed8b-4770-9c84-dbe721028873]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:17 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a6291f-05fa-4e04-b0e5-7890d54ffb88]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e9f41e-363f-4f83-9939-2f4dde023825]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8a219f-bd3d-4673-b5ba-155e98c51bcd]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9322d2b1-21f0-41f2-b733-06ddf84bf901]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1103dc-2ef1-49ef-ae59-f0c69fe6555e]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9, portal: 172.16.0.220,3260]
Nov 14 22:43:18 user nova-compute[76815]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9, portal: 172.16.0.220,3260] successful.
Nov 14 22:43:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dc87c5f-7bb6-435b-930d-7dc52bdcfbd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f09cab-b9d0-42f9-98b1-f414a8787c24]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] <== disconnect_volume: return (292ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG nova.objects.instance [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'flavor' on Instance uuid 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-190f2f56-94f8-4253-ba4c-6b47c1645d11 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-655053fa-744b-48ee-92da-04dd377da54d req-b81fc4d4-ca76-492d-86bd-9a28de409c51 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-changed-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG nova.compute.manager [req-655053fa-744b-48ee-92da-04dd377da54d req-b81fc4d4-ca76-492d-86bd-9a28de409c51 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Refreshing instance network info cache due to event network-changed-35df3788-4c76-4df0-b7f2-ae06436f800d. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-655053fa-744b-48ee-92da-04dd377da54d req-b81fc4d4-ca76-492d-86bd-9a28de409c51 service nova] Acquiring lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-655053fa-744b-48ee-92da-04dd377da54d req-b81fc4d4-ca76-492d-86bd-9a28de409c51 service nova] Acquired lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG nova.network.neutron [req-655053fa-744b-48ee-92da-04dd377da54d req-b81fc4d4-ca76-492d-86bd-9a28de409c51 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Refreshing network info cache for port 35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'flavor' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG nova.network.neutron [req-655053fa-744b-48ee-92da-04dd377da54d req-b81fc4d4-ca76-492d-86bd-9a28de409c51 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updated VIF entry in instance network info cache for port 35df3788-4c76-4df0-b7f2-ae06436f800d. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG nova.network.neutron [req-655053fa-744b-48ee-92da-04dd377da54d req-b81fc4d4-ca76-492d-86bd-9a28de409c51 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:23 user nova-compute[76815]: INFO nova.compute.manager [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Attaching volume d118eb44-e247-4748-b380-0bf02c529f7f to /dev/vdb
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-655053fa-744b-48ee-92da-04dd377da54d req-b81fc4d4-ca76-492d-86bd-9a28de409c51 service nova] Releasing lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG os_brick.utils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5326a5-fb0a-4eb3-bb7c-753c8175144d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5a71ff-c0fe-47cd-9c3d-0654e950c6db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fdf2a1-5949-4b52-8e78-f94b062e6678]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47db778-a47e-4bf2-83ea-34b3b79f2f91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:43:23 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:43:23 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cefbf2b-a88d-43e8-b1e1-cc5426e143e2]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG os_brick.utils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:43:23 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating existing volume attachment record: de967312-d09d-4aa3-b067-e42534a532be {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Verify base images {{(pid=76815) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Image id 17f0b7df-7e07-48b3-bb67-6524172efa0a yields fingerprint 671dcf04805df5f968a361885670012072ed1b4b {{(pid=76815) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 22:43:24 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] image 17f0b7df-7e07-48b3-bb67-6524172efa0a at (/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b): checking
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] image 17f0b7df-7e07-48b3-bb67-6524172efa0a at (/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b): image is in use {{(pid=76815) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=76815) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] 92a51373-b728-4a91-a503-a87740e84895 is a valid instance name {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] 92a51373-b728-4a91-a503-a87740e84895 has a disk file {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 is backed by 671dcf04805df5f968a361885670012072ed1b4b {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] 038b8a86-c1ae-43c6-b5ac-d560babe8258 is a valid instance name {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] 038b8a86-c1ae-43c6-b5ac-d560babe8258 has a disk file {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 is backed by 671dcf04805df5f968a361885670012072ed1b4b {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 is a valid instance name {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 has a disk file {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 is backed by 671dcf04805df5f968a361885670012072ed1b4b {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] cb981494-6911-4ae9-a88b-3770d7b05049 is a valid instance name {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] cb981494-6911-4ae9-a88b-3770d7b05049 has a disk file {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance cb981494-6911-4ae9-a88b-3770d7b05049 is backed by 671dcf04805df5f968a361885670012072ed1b4b {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] 729a56a3-cad3-4b94-9f45-ecf919f955d6 is a valid instance name {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] 729a56a3-cad3-4b94-9f45-ecf919f955d6 has a disk file {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 22:43:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 is backed by 671dcf04805df5f968a361885670012072ed1b4b {{(pid=76815) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 22:43:25 user nova-compute[76815]: WARNING nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Unknown base file: /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2
Nov 14 22:43:25 user nova-compute[76815]: WARNING nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Unknown base file: /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3
Nov 14 22:43:25 user nova-compute[76815]: WARNING nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Unknown base file: /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b
Nov 14 22:43:25 user nova-compute[76815]: WARNING nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Unknown base file: /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e
Nov 14 22:43:25 user nova-compute[76815]: WARNING nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Unknown base file: /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3
Nov 14 22:43:25 user nova-compute[76815]: WARNING nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Unknown base file: /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c
Nov 14 22:43:25 user nova-compute[76815]: WARNING nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Unknown base file: /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6
Nov 14 22:43:25 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Active base files: /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b
Nov 14 22:43:25 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Removable base files: /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2 /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3 /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3 /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6
Nov 14 22:43:25 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7aac9ce0664ab230553d7b3f86e23e7b23eba6c2
Nov 14 22:43:25 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6061eb7e610fa0aaf27fa07d74b22d5e5fac90f3
Nov 14 22:43:25 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/200fc229fb75755e21d37500b69af652a700421b
Nov 14 22:43:25 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/871b1b63fb21f63424a21841d5746388ad15eb5e
Nov 14 22:43:25 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/07cb8ac75e367ecefa16c9cb59b4182d13b179b3
Nov 14 22:43:25 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/02eee2bd2288c6a8e19dd5a9c8c3a28f1e7b657c
Nov 14 22:43:25 user nova-compute[76815]: INFO nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c13186948b77db895a2bd90cd8af029f96bc94d6
Nov 14 22:43:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Verification complete {{(pid=76815) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 22:43:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Verify swap images {{(pid=76815) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 22:43:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.imagecache [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Verify ephemeral images {{(pid=76815) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 22:43:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZwgxGPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:43:28 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:43:28 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:43:28 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aeaee7-0d6e-48be-b40c-9ffbf2d3b77e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:43:28 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b231ec-492c-4137-a50e-66d7026bfed4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f] added
Nov 14 22:43:28 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb9145f-9dee-48e1-a54c-bcf0061ca345]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b755c87-0c1f-406a-b5a2-eefb17035e91]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UZwgxGPd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UZwgxGPd" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40e9b28-3e99-429c-a56c-5cda4c4aa710]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UZwgxGPd'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfa5a68-9a78-4567-a006-9f565358da49]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e63df0-e812-4c38-92bd-a139e0d6444c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:43:28 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:43:28 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:43:28 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:43:28 user nova-compute[76815]: 
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ad521a-9032-439c-91d8-ca4b45618f60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f, portal: 172.16.0.220,3260]
Nov 14 22:43:28 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f, portal: 172.16.0.220,3260] successful.
Nov 14 22:43:28 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2d0777-65e8-4a2f-9398-f3c1be6ebb8d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a6168-8971-4639-b8b1-4ba34406026a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:43:28 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:43:28 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb791a6-f645-4115-be2b-327306060f58]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:43:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZwgxGPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:43:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:43:29 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26331633164353365', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:43:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331633164353365', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:43:29 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'flavor' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:43:29 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:43:29 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:43:29 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:43:29 user nova-compute[76815]:   <serial>d118eb44-e247-4748-b380-0bf02c529f7f</serial>
Nov 14 22:43:29 user nova-compute[76815]: </disk>
Nov 14 22:43:29 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:43:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:43:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:43:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No VIF found with MAC fa:16:3e:1b:60:80, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:43:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0171245c-6ba7-431b-9bc5-9291815cd84c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.302s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:30 user nova-compute[76815]: INFO nova.compute.manager [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Rescuing
Nov 14 22:43:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquired lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG nova.network.neutron [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG nova.network.neutron [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Releasing lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-cfe36f10-485e-47aa-8005-e7720df68e25 req-81ee5bff-d208-4a86-97cc-6e2a67ab7858 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cfe36f10-485e-47aa-8005-e7720df68e25 req-81ee5bff-d208-4a86-97cc-6e2a67ab7858 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cfe36f10-485e-47aa-8005-e7720df68e25 req-81ee5bff-d208-4a86-97cc-6e2a67ab7858 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cfe36f10-485e-47aa-8005-e7720df68e25 req-81ee5bff-d208-4a86-97cc-6e2a67ab7858 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:30 user nova-compute[76815]: DEBUG nova.compute.manager [req-cfe36f10-485e-47aa-8005-e7720df68e25 req-81ee5bff-d208-4a86-97cc-6e2a67ab7858 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:30 user nova-compute[76815]: WARNING nova.compute.manager [req-cfe36f10-485e-47aa-8005-e7720df68e25 req-81ee5bff-d208-4a86-97cc-6e2a67ab7858 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state active and task_state rescuing.
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Instance destroyed successfully.
Nov 14 22:43:31 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Attempting rescue
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=76815) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Instance directory exists: not creating {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 22:43:31 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Creating image(s)
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.instance [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'trusted_certs' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue" returned: 0 in 0.047s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.instance [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'migration_context' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.base [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<cb981494-6911-4ae9-a88b-3770d7b05049> lazy-loaded attributes: trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Start _get_guest_xml network_info=[{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "vif_mac": "fa:16:3e:1b:60:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.instance [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'resources' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.base [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<cb981494-6911-4ae9-a88b-3770d7b05049> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.instance [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'numa_topology' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.base [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<cb981494-6911-4ae9-a88b-3770d7b05049> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:43:31 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:43:31 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.instance [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.base [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<cb981494-6911-4ae9-a88b-3770d7b05049> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1301907907',display_name='tempest-ServerRescueNegativeTestJSON-server-1301907907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1301907907',id=47,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGWgPVNwI8DhuqwOjdohDACPc5+dcRRRpmNT48qpO7BhRQxWDcHA5eWe6UINmc1InAGk07XfG40k/ye14BWaCMwLoGZfZ3e32c8lwL2fWVdFf5fPoiTEe2PWh+/kGb6Kg==',key_name='tempest-keypair-1284410080',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:41:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-35oa0v8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=cb981494-6911-4ae9-a88b-3770d7b05049,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "vif_mac": "fa:16:3e:1b:60:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "vif_mac": "fa:16:3e:1b:60:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:60:80,bridge_name='br-int',has_traffic_filtering=True,id=35df3788-4c76-4df0-b7f2-ae06436f800d,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35df3788-4c') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.instance [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'pci_devices' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.objects.base [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Object Instance<cb981494-6911-4ae9-a88b-3770d7b05049> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:43:31 user nova-compute[76815]:   <uuid>cb981494-6911-4ae9-a88b-3770d7b05049</uuid>
Nov 14 22:43:31 user nova-compute[76815]:   <name>instance-0000002f</name>
Nov 14 22:43:31 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:43:31 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:43:31 user nova-compute[76815]:   <metadata>
Nov 14 22:43:31 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:43:31 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:43:31 user nova-compute[76815]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1301907907</nova:name>
Nov 14 22:43:31 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:43:31</nova:creationTime>
Nov 14 22:43:31 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:43:31 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:43:31 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:43:31 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:43:31 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:43:31 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:43:31 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:43:31 user nova-compute[76815]:       <nova:owner>
Nov 14 22:43:31 user nova-compute[76815]:         <nova:user uuid="d7726302e74c45ba94acea58ff3ca7c6">tempest-ServerRescueNegativeTestJSON-1323022133-project-member</nova:user>
Nov 14 22:43:31 user nova-compute[76815]:         <nova:project uuid="b06ff4e376e9419babeacd8a4d586574">tempest-ServerRescueNegativeTestJSON-1323022133</nova:project>
Nov 14 22:43:31 user nova-compute[76815]:       </nova:owner>
Nov 14 22:43:31 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:43:31 user nova-compute[76815]:       <nova:ports>
Nov 14 22:43:31 user nova-compute[76815]:         <nova:port uuid="35df3788-4c76-4df0-b7f2-ae06436f800d">
Nov 14 22:43:31 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 22:43:31 user nova-compute[76815]:         </nova:port>
Nov 14 22:43:31 user nova-compute[76815]:       </nova:ports>
Nov 14 22:43:31 user nova-compute[76815]:     </nova:instance>
Nov 14 22:43:31 user nova-compute[76815]:   </metadata>
Nov 14 22:43:31 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:43:31 user nova-compute[76815]:     <system>
Nov 14 22:43:31 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:43:31 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:43:31 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:43:31 user nova-compute[76815]:       <entry name="serial">cb981494-6911-4ae9-a88b-3770d7b05049</entry>
Nov 14 22:43:31 user nova-compute[76815]:       <entry name="uuid">cb981494-6911-4ae9-a88b-3770d7b05049</entry>
Nov 14 22:43:31 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:43:31 user nova-compute[76815]:     </system>
Nov 14 22:43:31 user nova-compute[76815]:   </sysinfo>
Nov 14 22:43:31 user nova-compute[76815]:   <os>
Nov 14 22:43:31 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:43:31 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:43:31 user nova-compute[76815]:   </os>
Nov 14 22:43:31 user nova-compute[76815]:   <features>
Nov 14 22:43:31 user nova-compute[76815]:     <acpi/>
Nov 14 22:43:31 user nova-compute[76815]:     <apic/>
Nov 14 22:43:31 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:43:31 user nova-compute[76815]:   </features>
Nov 14 22:43:31 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:43:31 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:43:31 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:43:31 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:43:31 user nova-compute[76815]:   </clock>
Nov 14 22:43:31 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:43:31 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:43:31 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:43:31 user nova-compute[76815]:   </cpu>
Nov 14 22:43:31 user nova-compute[76815]:   <devices>
Nov 14 22:43:31 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:43:31 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:43:31 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue"/>
Nov 14 22:43:31 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:43:31 user nova-compute[76815]:     </disk>
Nov 14 22:43:31 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:43:31 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:43:31 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk"/>
Nov 14 22:43:31 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:43:31 user nova-compute[76815]:     </disk>
Nov 14 22:43:31 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:43:31 user nova-compute[76815]:       <mac address="fa:16:3e:1b:60:80"/>
Nov 14 22:43:31 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:43:31 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:43:31 user nova-compute[76815]:       <target dev="tap35df3788-4c"/>
Nov 14 22:43:31 user nova-compute[76815]:     </interface>
Nov 14 22:43:31 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:43:31 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/console.log" append="off"/>
Nov 14 22:43:31 user nova-compute[76815]:     </serial>
Nov 14 22:43:31 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:43:31 user nova-compute[76815]:     <video>
Nov 14 22:43:31 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:43:31 user nova-compute[76815]:     </video>
Nov 14 22:43:31 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:43:31 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:43:31 user nova-compute[76815]:     </rng>
Nov 14 22:43:31 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:43:31 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:43:31 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:43:31 user nova-compute[76815]:     </memballoon>
Nov 14 22:43:31 user nova-compute[76815]:   </devices>
Nov 14 22:43:31 user nova-compute[76815]: </domain>
Nov 14 22:43:31 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:43:31 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Instance destroyed successfully.
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:43:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] No VIF found with MAC fa:16:3e:1b:60:80, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:43:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:33 user nova-compute[76815]: WARNING nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state active and task_state rescuing.
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:33 user nova-compute[76815]: WARNING nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state active and task_state rescuing.
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:33 user nova-compute[76815]: WARNING nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state active and task_state rescuing.
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:33 user nova-compute[76815]: WARNING nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state active and task_state rescuing.
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:33 user nova-compute[76815]: WARNING nova.compute.manager [req-e3e6a268-e30a-4181-9bc3-58b128c1ef7e req-eb65ffe6-3346-4032-a6ea-77ab4a0ec205 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state active and task_state rescuing.
Nov 14 22:43:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:35 user nova-compute[76815]: WARNING nova.compute.manager [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state active and task_state rescuing.
Nov 14 22:43:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:35 user nova-compute[76815]: WARNING nova.compute.manager [req-2c826051-f9bd-4c85-a6f9-758880bcc371 req-252823a9-dc12-4147-abcc-10d4fbbf5f37 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state active and task_state rescuing.
Nov 14 22:43:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:35 user nova-compute[76815]: DEBUG nova.compute.manager [None req-87fb4694-0fd3-455a-9415-b1c91aeddf65 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:43:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:47 user nova-compute[76815]: INFO nova.compute.manager [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Terminating instance
Nov 14 22:43:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-7fd84379-a90d-4315-911e-295856e5549f req-5cd0cb64-6539-401b-a229-fefd3e95332d service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received event network-vif-unplugged-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7fd84379-a90d-4315-911e-295856e5549f req-5cd0cb64-6539-401b-a229-fefd3e95332d service nova] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7fd84379-a90d-4315-911e-295856e5549f req-5cd0cb64-6539-401b-a229-fefd3e95332d service nova] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7fd84379-a90d-4315-911e-295856e5549f req-5cd0cb64-6539-401b-a229-fefd3e95332d service nova] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-7fd84379-a90d-4315-911e-295856e5549f req-5cd0cb64-6539-401b-a229-fefd3e95332d service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] No waiting events found dispatching network-vif-unplugged-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:47 user nova-compute[76815]: DEBUG nova.compute.manager [req-7fd84379-a90d-4315-911e-295856e5549f req-5cd0cb64-6539-401b-a229-fefd3e95332d service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received event network-vif-unplugged-99bd9f8e-76a3-4f13-b5d6-95441772720e for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:43:48 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Instance destroyed successfully.
Nov 14 22:43:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lazy-loading 'resources' on Instance uuid 939c4458-e3a3-4ec2-a2c2-465f3b1bba35 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:40:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-505785802',display_name='tempest-AttachVolumeNegativeTest-server-505785802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-505785802',id=46,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACDkmid0J/qAixNsnfOpJT0C9LcIqEfEJtMOeiTfJ7jNFxPa5ELJ0p+bRcJ8UczfHKyhIg0EjSujHTQ+g75j51Kk1knzvr0glzO33YSWYhAADjF3P4feeevCaP0itxZWg==',key_name='tempest-keypair-962253964',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:41:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd690e5ff8584e2f9e24597816d90b98',ramdisk_id='',reservation_id='r-06kiee93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-716641985',owner_user_name='tempest-AttachVolumeNegativeTest-716641985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:41:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26aadea3a6964715be30b0fbb2c61c6b',uuid=939c4458-e3a3-4ec2-a2c2-465f3b1bba35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converting VIF {"id": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "address": "fa:16:3e:5d:6f:f6", "network": {"id": "24629d9c-92ec-4a34-9ddf-29a155132e9e", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1062766612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd690e5ff8584e2f9e24597816d90b98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bd9f8e-76", "ovs_interfaceid": "99bd9f8e-76a3-4f13-b5d6-95441772720e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:6f:f6,bridge_name='br-int',has_traffic_filtering=True,id=99bd9f8e-76a3-4f13-b5d6-95441772720e,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bd9f8e-76') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG os_vif [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:6f:f6,bridge_name='br-int',has_traffic_filtering=True,id=99bd9f8e-76a3-4f13-b5d6-95441772720e,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bd9f8e-76') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99bd9f8e-76, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a00b9dc-df4b-4daa-83eb-408aa2f06d3d) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:48 user nova-compute[76815]: INFO os_vif [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:6f:f6,bridge_name='br-int',has_traffic_filtering=True,id=99bd9f8e-76a3-4f13-b5d6-95441772720e,network=Network(24629d9c-92ec-4a34-9ddf-29a155132e9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bd9f8e-76')
Nov 14 22:43:48 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Deleting instance files /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35_del
Nov 14 22:43:48 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Deletion of /opt/stack/data/nova/instances/939c4458-e3a3-4ec2-a2c2-465f3b1bba35_del complete
Nov 14 22:43:48 user nova-compute[76815]: INFO nova.compute.manager [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 22:43:48 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:43:48 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:43:49 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Took 0.66 seconds to deallocate network for instance.
Nov 14 22:43:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:49 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Deleted allocations for instance 939c4458-e3a3-4ec2-a2c2-465f3b1bba35
Nov 14 22:43:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-c6adf3e7-7b89-4d44-a815-007098c44364 tempest-AttachVolumeNegativeTest-716641985 tempest-AttachVolumeNegativeTest-716641985-project-member] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.907s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-743e3b46-c105-417c-b13d-b7505c8e6b66 req-8fc92934-b402-4e5a-91e2-06077be984f2 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received event network-vif-plugged-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-743e3b46-c105-417c-b13d-b7505c8e6b66 req-8fc92934-b402-4e5a-91e2-06077be984f2 service nova] Acquiring lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-743e3b46-c105-417c-b13d-b7505c8e6b66 req-8fc92934-b402-4e5a-91e2-06077be984f2 service nova] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-743e3b46-c105-417c-b13d-b7505c8e6b66 req-8fc92934-b402-4e5a-91e2-06077be984f2 service nova] Lock "939c4458-e3a3-4ec2-a2c2-465f3b1bba35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-743e3b46-c105-417c-b13d-b7505c8e6b66 req-8fc92934-b402-4e5a-91e2-06077be984f2 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] No waiting events found dispatching network-vif-plugged-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:43:49 user nova-compute[76815]: WARNING nova.compute.manager [req-743e3b46-c105-417c-b13d-b7505c8e6b66 req-8fc92934-b402-4e5a-91e2-06077be984f2 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received unexpected event network-vif-plugged-99bd9f8e-76a3-4f13-b5d6-95441772720e for instance with vm_state deleted and task_state None.
Nov 14 22:43:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-743e3b46-c105-417c-b13d-b7505c8e6b66 req-8fc92934-b402-4e5a-91e2-06077be984f2 service nova] [instance: 939c4458-e3a3-4ec2-a2c2-465f3b1bba35] Received event network-vif-deleted-99bd9f8e-76a3-4f13-b5d6-95441772720e {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:43:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:43:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:01 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:44:01 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8587MB free_disk=24.98674774169922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance cb981494-6911-4ae9-a88b-3770d7b05049 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:44:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:44:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-a495c0f4-209f-4dd4-8418-52102148864a req-ffaf02ea-877e-4b12-923f-0a5226062eaa service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received event network-changed-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG nova.compute.manager [req-a495c0f4-209f-4dd4-8418-52102148864a req-ffaf02ea-877e-4b12-923f-0a5226062eaa service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Refreshing instance network info cache due to event network-changed-959b3839-b291-4645-a12f-24e657e89e62. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a495c0f4-209f-4dd4-8418-52102148864a req-ffaf02ea-877e-4b12-923f-0a5226062eaa service nova] Acquiring lock "refresh_cache-729a56a3-cad3-4b94-9f45-ecf919f955d6" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a495c0f4-209f-4dd4-8418-52102148864a req-ffaf02ea-877e-4b12-923f-0a5226062eaa service nova] Acquired lock "refresh_cache-729a56a3-cad3-4b94-9f45-ecf919f955d6" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:44:03 user nova-compute[76815]: DEBUG nova.network.neutron [req-a495c0f4-209f-4dd4-8418-52102148864a req-ffaf02ea-877e-4b12-923f-0a5226062eaa service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Refreshing network info cache for port 959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:44:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-a495c0f4-209f-4dd4-8418-52102148864a req-ffaf02ea-877e-4b12-923f-0a5226062eaa service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Updated VIF entry in instance network info cache for port 959b3839-b291-4645-a12f-24e657e89e62. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:44:04 user nova-compute[76815]: DEBUG nova.network.neutron [req-a495c0f4-209f-4dd4-8418-52102148864a req-ffaf02ea-877e-4b12-923f-0a5226062eaa service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Updating instance_info_cache with network_info: [{"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:44:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a495c0f4-209f-4dd4-8418-52102148864a req-ffaf02ea-877e-4b12-923f-0a5226062eaa service nova] Releasing lock "refresh_cache-729a56a3-cad3-4b94-9f45-ecf919f955d6" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:44:05 user nova-compute[76815]: INFO nova.compute.manager [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Attaching volume b5358e37-b1c7-42ba-8d60-8cb87ee74142 to /dev/vdb
Nov 14 22:44:05 user nova-compute[76815]: DEBUG os_brick.utils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e670a-1075-4b22-b4e2-a9a7c2d820b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6294375-d56f-43c3-8714-8953bf382964]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeefc24-9a70-4e50-b1e3-9bd7953a0d17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[203161cc-834f-4c8f-82c9-ff90ba9530a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:44:05 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:44:05 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4863e8c4-795b-4d9f-9257-4d4d13ee5344]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG os_brick.utils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:44:05 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Updating existing volume attachment record: 7adea4fb-5026-4a1f-9dde-9ebab7c7a8f0 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:44:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiJpLTPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:44:10 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:44:10 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:44:10 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deb52d8-fb8e-4479-b4a8-ee2ce38ebda8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:44:10 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fc9a74-8709-441c-8c2d-fa9c0a6539b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142] added
Nov 14 22:44:10 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afcf6c9-627f-4f90-acd5-bfd0a0b38e12]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[890470fb-88c4-44ef-91b5-d727e4a53732]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiJpLTPq {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NiJpLTPq" returned: 0 in 0.031s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[be745249-30a2-4d1a-ae5d-7c1b1f623377]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NiJpLTPq'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[435835d9-25e5-4aee-849b-984fef6aeb02]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b013d6c-4246-4bb0-9b33-ad91fd7129ea]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:10 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:10 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[909cc5cb-b492-4929-bc33-f1550e9f012e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142, portal: 172.16.0.220,3260]
Nov 14 22:44:10 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142, portal: 172.16.0.220,3260] successful.
Nov 14 22:44:10 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfb91d5-485c-40db-a466-df4969d34340]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df23ead3-ed5e-42bd-83d1-54fc46b511f9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:10 user nova-compute[76815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)
Nov 14 22:44:10 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:10 user nova-compute[76815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)
Nov 14 22:44:10 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c675b93-00e6-4066-be26-f3028e304d1d]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:44:10 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiJpLTPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26336343632316138', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336343632316138', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:44:11 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:44:11 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:44:11 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:44:11 user nova-compute[76815]:   <serial>b5358e37-b1c7-42ba-8d60-8cb87ee74142</serial>
Nov 14 22:44:11 user nova-compute[76815]: </disk>
Nov 14 22:44:11 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No VIF found with MAC fa:16:3e:42:09:24, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:44:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0db466eb-7b96-488a-8928-bdb01b5d8e3e tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.318s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:44:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG nova.objects.instance [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:44:13 user nova-compute[76815]: INFO nova.compute.manager [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Attaching volume 08b7555f-760c-44fd-ae1f-28beb5ef3778 to /dev/vdc
Nov 14 22:44:13 user nova-compute[76815]: DEBUG os_brick.utils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[924223ff-eb7e-4551-979e-853615c9f9bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44e904b-67f2-4397-bec4-b8cd8115312c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee19d9b1-8b8e-4fd7-b206-8bb18479ff6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[070063e8-2811-406d-9794-d256a45ab005]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:44:13 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:44:13 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d15332-a388-429d-aaf1-ef74a3b9729e]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG os_brick.utils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:44:13 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Updating existing volume attachment record: b498db24-3306-4c5d-853f-74e5a824794a {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVzSXpDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:44:18 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:44:18 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:44:18 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c480e4-16db-4aac-ab6b-81bf15a062b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:44:18 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f516559e-a3d3-44bc-b0fd-7bce404ddc0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778] added
Nov 14 22:44:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d536b2-ce56-4e02-b38c-79a438c8d6f3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[03da6307-cc5b-4640-9204-c47cbfe1f66f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVzSXpDa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVzSXpDa" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2812b7-85e9-47a9-afa1-c9a39f8b954d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bVzSXpDa'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[08532db5-703b-4369-a66a-60d8ed8d9ef9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce457b47-d0e4-4797-95a7-a86dc16db867]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:18 user nova-compute[76815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)
Nov 14 22:44:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:18 user nova-compute[76815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)
Nov 14 22:44:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d3b0ad-b16f-459e-9f55-57e78ecdee79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778, portal: 172.16.0.220,3260]
Nov 14 22:44:18 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778, portal: 172.16.0.220,3260] successful.
Nov 14 22:44:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b03c048-e9e3-44e1-a9f1-57fff715372e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f203adfe-9327-43fc-865b-5c975300482e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:18 user nova-compute[76815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)
Nov 14 22:44:18 user nova-compute[76815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 (non-flash)
Nov 14 22:44:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:18 user nova-compute[76815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)
Nov 14 22:44:18 user nova-compute[76815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 (non-flash)
Nov 14 22:44:18 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e88d42-132c-47a1-8653-dd3a9a9d02c4]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:44:18 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVzSXpDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23437343230316335', 'path': '/dev/sdd'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437343230316335', 'path': '/dev/sdd'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG nova.objects.instance [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:44:19 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:44:19 user nova-compute[76815]:   <source dev="/dev/sdd"/>
Nov 14 22:44:19 user nova-compute[76815]:   <target dev="vdc" bus="virtio"/>
Nov 14 22:44:19 user nova-compute[76815]:   <serial>08b7555f-760c-44fd-ae1f-28beb5ef3778</serial>
Nov 14 22:44:19 user nova-compute[76815]: </disk>
Nov 14 22:44:19 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No BDM found with device name vdc, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:44:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] No VIF found with MAC fa:16:3e:42:09:24, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:44:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-612f7406-1e8f-4268-bc4b-ab63ca7922f0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.350s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:44:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:44:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:44:20 user nova-compute[76815]: INFO nova.compute.manager [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Detaching volume b5358e37-b1c7-42ba-8d60-8cb87ee74142
Nov 14 22:44:20 user nova-compute[76815]: INFO nova.virt.block_device [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Attempting to driver detach volume b5358e37-b1c7-42ba-8d60-8cb87ee74142 from mountpoint /dev/vdb
Nov 14 22:44:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Attempting to detach device vdb from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:44:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:44:20 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:44:20 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:44:20 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:44:20 user nova-compute[76815]:   <serial>b5358e37-b1c7-42ba-8d60-8cb87ee74142</serial>
Nov 14 22:44:20 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:44:20 user nova-compute[76815]: </disk>
Nov 14 22:44:20 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:44:20 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully detached device vdb from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 from the persistent domain config.
Nov 14 22:44:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:44:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:44:20 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:44:20 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:44:20 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:44:20 user nova-compute[76815]:   <serial>b5358e37-b1c7-42ba-8d60-8cb87ee74142</serial>
Nov 14 22:44:20 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:44:20 user nova-compute[76815]: </disk>
Nov 14 22:44:20 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:44:21 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:44:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:44:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:41 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 is timed out.
Nov 14 22:44:41 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully detached device vdb from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 from the live domain config.
Nov 14 22:44:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NiJpLTPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:44:41 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacd2c1c-1ad3-4008-b972-978f07a4c45f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:44:41 user nova-compute[76815]: No targets found.
Nov 14 22:44:41 user nova-compute[76815]: iSNS:
Nov 14 22:44:41 user nova-compute[76815]: No targets found.
Nov 14 22:44:41 user nova-compute[76815]: STATIC:
Nov 14 22:44:41 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778
Nov 14 22:44:41 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:44:41 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:44:41 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142
Nov 14 22:44:41 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:44:41 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:44:41 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f
Nov 14 22:44:41 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:44:41 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:44:41 user nova-compute[76815]: FIRMWARE:
Nov 14 22:44:41 user nova-compute[76815]: No targets found.
Nov 14 22:44:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:44:41 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:44:41 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e6acad-8114-4603-b576-b0a4320d3156]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3676603b-0922-4e1e-aebc-ad1f70965f1d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:41 user nova-compute[76815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)
Nov 14 22:44:41 user nova-compute[76815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 (non-flash)
Nov 14 22:44:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:44:41 user nova-compute[76815]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 (non-flash)
Nov 14 22:44:41 user nova-compute[76815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 (non-flash)
Nov 14 22:44:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a430bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a22617-e79c-41d4-abf8-c73c222c8c21]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc29784-a832-43c8-ba2b-b3acbe70c247]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[09415f09-54e0-45ca-91d8-796a89a2066e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[917766fb-67e4-4aa9-b36c-bb4593458a90]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cb985b-bf10-4782-8c65-e780164d9f5f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6248fa41-8f33-4771-a4f4-97577762ef9a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142, portal: 172.16.0.220,3260]
Nov 14 22:44:41 user nova-compute[76815]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142, portal: 172.16.0.220,3260] successful.
Nov 14 22:44:41 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5358e37-b1c7-42ba-8d60-8cb87ee74142 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee89911-2dd8-4213-bc55-3c20cc2bb3e1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== disconnect_volume: return (304ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:44:41 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:44:42 user nova-compute[76815]: DEBUG nova.objects.instance [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:44:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-04ecf1bd-0d5e-4bc2-b410-a3bb5db3e82b tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.257s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:43 user nova-compute[76815]: INFO nova.compute.manager [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Detaching volume 08b7555f-760c-44fd-ae1f-28beb5ef3778
Nov 14 22:44:43 user nova-compute[76815]: INFO nova.virt.block_device [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Attempting to driver detach volume 08b7555f-760c-44fd-ae1f-28beb5ef3778 from mountpoint /dev/vdc
Nov 14 22:44:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Attempting to detach device vdc from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:44:43 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:44:43 user nova-compute[76815]:   <source dev="/dev/sdd"/>
Nov 14 22:44:43 user nova-compute[76815]:   <target dev="vdc" bus="virtio"/>
Nov 14 22:44:43 user nova-compute[76815]:   <serial>08b7555f-760c-44fd-ae1f-28beb5ef3778</serial>
Nov 14 22:44:43 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 22:44:43 user nova-compute[76815]: </disk>
Nov 14 22:44:43 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:44:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully detached device vdc from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 from the persistent domain config.
Nov 14 22:44:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:44:43 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:44:43 user nova-compute[76815]:   <source dev="/dev/sdd"/>
Nov 14 22:44:43 user nova-compute[76815]:   <target dev="vdc" bus="virtio"/>
Nov 14 22:44:43 user nova-compute[76815]:   <serial>08b7555f-760c-44fd-ae1f-28beb5ef3778</serial>
Nov 14 22:44:43 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 22:44:43 user nova-compute[76815]: </disk>
Nov 14 22:44:43 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:44:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:44:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:44:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:00 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:01 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:45:01 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=24.97629165649414GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance cb981494-6911-4ae9-a88b-3770d7b05049 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:45:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:45:02 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:45:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:45:02 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:45:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:45:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:45:02 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:45:02 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:45:03 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 is timed out.
Nov 14 22:45:03 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully detached device vdc from instance 729a56a3-cad3-4b94-9f45-ecf919f955d6 from the live domain config.
Nov 14 22:45:03 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVzSXpDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:45:03 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe7ecb4-754e-4738-905d-07ff236f8378]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:45:03 user nova-compute[76815]: No targets found.
Nov 14 22:45:03 user nova-compute[76815]: iSNS:
Nov 14 22:45:03 user nova-compute[76815]: No targets found.
Nov 14 22:45:03 user nova-compute[76815]: STATIC:
Nov 14 22:45:03 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778
Nov 14 22:45:03 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:45:03 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:45:03 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f
Nov 14 22:45:03 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:45:03 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:45:03 user nova-compute[76815]: FIRMWARE:
Nov 14 22:45:03 user nova-compute[76815]: No targets found.
Nov 14 22:45:03 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:45:03 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:45:03 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c79152-962e-4b31-b393-482bcb4cc432]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[719b3e11-910e-4f97-a8d9-313d309aef78]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:45:03 user nova-compute[76815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 (non-flash)
Nov 14 22:45:03 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:45:03 user nova-compute[76815]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 (non-flash)
Nov 14 22:45:03 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8587eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778'): ({'sdd'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Removing single pathed devices sdd {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d1246f-4ad6-4ca6-9e4a-ca0f876b5ddb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dc4b2b-2898-48ae-811d-f90228ab7a01]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Flushing IO for device /dev/sdd {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b173fcb-86e3-4ab8-a73d-6e9aeb91f8b7]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:45:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbae37d4-fde2-462c-8fae-7e060991013c]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] SCSI volumes sdd have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1ce42c-1c85-4465-9203-c1336d65d555]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3842a1d-81ae-40b5-aa83-93131da576f7]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778, portal: 172.16.0.220,3260]
Nov 14 22:45:04 user nova-compute[76815]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778, portal: 172.16.0.220,3260] successful.
Nov 14 22:45:04 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08b7555f-760c-44fd-ae1f-28beb5ef3778 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fad769b-5e03-4869-9cca-d142861a50bc]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] <== disconnect_volume: return (301ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG nova.objects.instance [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'flavor' on Instance uuid 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:45:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-52b7097a-05ae-424b-8b7b-4ea8da53ade0 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:06 user nova-compute[76815]: INFO nova.compute.manager [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Terminating instance
Nov 14 22:45:06 user nova-compute[76815]: DEBUG nova.compute.manager [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-dc9a1813-1678-4cdb-ab49-5ac21db7314c req-c9f599ce-0f38-43f6-8f1f-9770cfb76c2a service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received event network-vif-unplugged-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-dc9a1813-1678-4cdb-ab49-5ac21db7314c req-c9f599ce-0f38-43f6-8f1f-9770cfb76c2a service nova] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-dc9a1813-1678-4cdb-ab49-5ac21db7314c req-c9f599ce-0f38-43f6-8f1f-9770cfb76c2a service nova] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-dc9a1813-1678-4cdb-ab49-5ac21db7314c req-c9f599ce-0f38-43f6-8f1f-9770cfb76c2a service nova] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-dc9a1813-1678-4cdb-ab49-5ac21db7314c req-c9f599ce-0f38-43f6-8f1f-9770cfb76c2a service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] No waiting events found dispatching network-vif-unplugged-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:45:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-dc9a1813-1678-4cdb-ab49-5ac21db7314c req-c9f599ce-0f38-43f6-8f1f-9770cfb76c2a service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received event network-vif-unplugged-959b3839-b291-4645-a12f-24e657e89e62 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:45:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Instance destroyed successfully.
Nov 14 22:45:07 user nova-compute[76815]: DEBUG nova.objects.instance [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lazy-loading 'resources' on Instance uuid 729a56a3-cad3-4b94-9f45-ecf919f955d6 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-615020152',display_name='tempest-AttachVolumeTestJSON-server-615020152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-615020152',id=48,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+1K8SCsObrOlb2JU0m3K2wHq8p9vD04F/S+dJlr4IFVnJLUGIXOYT5HwGvNkshSoj/0cpLIMEnDxMSOY603aOdKUJnavkpTCepTD7oejNvUOdgaxcPfvnp11u4ZqpgmQ==',key_name='tempest-keypair-712419283',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:42:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e13ac882a01d4abfa130458292b5cd40',ramdisk_id='',reservation_id='r-t0n5q470',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-252609817',owner_user_name='tempest-AttachVolumeTestJSON-252609817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3590183279e742f0bced96008d784cfb',uuid=729a56a3-cad3-4b94-9f45-ecf919f955d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converting VIF {"id": "959b3839-b291-4645-a12f-24e657e89e62", "address": "fa:16:3e:42:09:24", "network": {"id": "dfaab4d5-d940-4409-9095-26e2623e192b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-314543717-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e13ac882a01d4abfa130458292b5cd40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap959b3839-b2", "ovs_interfaceid": "959b3839-b291-4645-a12f-24e657e89e62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:09:24,bridge_name='br-int',has_traffic_filtering=True,id=959b3839-b291-4645-a12f-24e657e89e62,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap959b3839-b2') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG os_vif [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:09:24,bridge_name='br-int',has_traffic_filtering=True,id=959b3839-b291-4645-a12f-24e657e89e62,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap959b3839-b2') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap959b3839-b2, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8086757-a732-4df6-afce-45d32959d4a3) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:45:07 user nova-compute[76815]: INFO os_vif [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:09:24,bridge_name='br-int',has_traffic_filtering=True,id=959b3839-b291-4645-a12f-24e657e89e62,network=Network(dfaab4d5-d940-4409-9095-26e2623e192b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap959b3839-b2')
Nov 14 22:45:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Deleting instance files /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6_del
Nov 14 22:45:07 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Deletion of /opt/stack/data/nova/instances/729a56a3-cad3-4b94-9f45-ecf919f955d6_del complete
Nov 14 22:45:07 user nova-compute[76815]: INFO nova.compute.manager [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 22:45:07 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:45:07 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:45:08 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Took 1.49 seconds to deallocate network for instance.
Nov 14 22:45:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-83bf9208-242a-415c-96b3-2825bfc54ca6 req-df60d720-91a5-4463-974b-84c868a04ef9 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received event network-vif-plugged-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-83bf9208-242a-415c-96b3-2825bfc54ca6 req-df60d720-91a5-4463-974b-84c868a04ef9 service nova] Acquiring lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-83bf9208-242a-415c-96b3-2825bfc54ca6 req-df60d720-91a5-4463-974b-84c868a04ef9 service nova] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-83bf9208-242a-415c-96b3-2825bfc54ca6 req-df60d720-91a5-4463-974b-84c868a04ef9 service nova] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-83bf9208-242a-415c-96b3-2825bfc54ca6 req-df60d720-91a5-4463-974b-84c868a04ef9 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] No waiting events found dispatching network-vif-plugged-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:45:08 user nova-compute[76815]: WARNING nova.compute.manager [req-83bf9208-242a-415c-96b3-2825bfc54ca6 req-df60d720-91a5-4463-974b-84c868a04ef9 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received unexpected event network-vif-plugged-959b3839-b291-4645-a12f-24e657e89e62 for instance with vm_state deleted and task_state None.
Nov 14 22:45:08 user nova-compute[76815]: DEBUG nova.compute.manager [req-83bf9208-242a-415c-96b3-2825bfc54ca6 req-df60d720-91a5-4463-974b-84c868a04ef9 service nova] [instance: 729a56a3-cad3-4b94-9f45-ecf919f955d6] Received event network-vif-deleted-959b3839-b291-4645-a12f-24e657e89e62 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:08 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Deleted allocations for instance 729a56a3-cad3-4b94-9f45-ecf919f955d6
Nov 14 22:45:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-979e05f6-4463-4152-bcfb-3b73bbcbcdc8 tempest-AttachVolumeTestJSON-252609817 tempest-AttachVolumeTestJSON-252609817-project-member] Lock "729a56a3-cad3-4b94-9f45-ecf919f955d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.689s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:09 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:45:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_power_states {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "92a51373-b728-4a91-a503-a87740e84895" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "92a51373-b728-4a91-a503-a87740e84895" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:15 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:45:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquiring lock "3ab30b6f-1bae-444d-97e6-cd74a7099523" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:45:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:17 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:45:17 user nova-compute[76815]: INFO nova.compute.claims [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Claim successful on node user
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:45:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.policy [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd20a5a371c7408a89aa50d727527a55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c75ce667c7e5443cb8da55c18ebe3270', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:45:18 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Creating image(s)
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "/opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "/opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk 1073741824" returned: 0 in 0.055s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:18 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Successfully created port: fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Cannot resize image /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Ensure instance console log exists: /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Successfully updated port: fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquiring lock "refresh_cache-3ab30b6f-1bae-444d-97e6-cd74a7099523" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquired lock "refresh_cache-3ab30b6f-1bae-444d-97e6-cd74a7099523" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-1b79d608-0c3c-4163-8c60-ec1df0fe492a req-fca629ca-cd10-453a-8905-6dc23119eaca service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received event network-changed-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG nova.compute.manager [req-1b79d608-0c3c-4163-8c60-ec1df0fe492a req-fca629ca-cd10-453a-8905-6dc23119eaca service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Refreshing instance network info cache due to event network-changed-fbda539e-ce2c-4416-a607-931025096d5b. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1b79d608-0c3c-4163-8c60-ec1df0fe492a req-fca629ca-cd10-453a-8905-6dc23119eaca service nova] Acquiring lock "refresh_cache-3ab30b6f-1bae-444d-97e6-cd74a7099523" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:45:19 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Updating instance_info_cache with network_info: [{"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Releasing lock "refresh_cache-3ab30b6f-1bae-444d-97e6-cd74a7099523" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Instance network_info: |[{"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1b79d608-0c3c-4163-8c60-ec1df0fe492a req-fca629ca-cd10-453a-8905-6dc23119eaca service nova] Acquired lock "refresh_cache-3ab30b6f-1bae-444d-97e6-cd74a7099523" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.network.neutron [req-1b79d608-0c3c-4163-8c60-ec1df0fe492a req-fca629ca-cd10-453a-8905-6dc23119eaca service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Refreshing network info cache for port fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Start _get_guest_xml network_info=[{"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:45:20 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:45:20 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-356360003',display_name='tempest-VolumesActionsTest-instance-356360003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-356360003',id=49,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c75ce667c7e5443cb8da55c18ebe3270',ramdisk_id='',reservation_id='r-uaispyn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1270448896',owner_user_name='tempest-VolumesActionsTest-1270448896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:45:18Z,user_data=None,user_id='fd20a5a371c7408a89aa50d727527a55',uuid=3ab30b6f-1bae-444d-97e6-cd74a7099523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Converting VIF {"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=fbda539e-ce2c-4416-a607-931025096d5b,network=Network(bea33bfb-175d-464c-9f23-2b46dbf33594),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbda539e-ce') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ab30b6f-1bae-444d-97e6-cd74a7099523 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:45:20 user nova-compute[76815]:   <uuid>3ab30b6f-1bae-444d-97e6-cd74a7099523</uuid>
Nov 14 22:45:20 user nova-compute[76815]:   <name>instance-00000031</name>
Nov 14 22:45:20 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:45:20 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:45:20 user nova-compute[76815]:   <metadata>
Nov 14 22:45:20 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:45:20 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:45:20 user nova-compute[76815]:       <nova:name>tempest-VolumesActionsTest-instance-356360003</nova:name>
Nov 14 22:45:20 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:45:20</nova:creationTime>
Nov 14 22:45:20 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:45:20 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:45:20 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:45:20 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:45:20 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:45:20 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:45:20 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:45:20 user nova-compute[76815]:       <nova:owner>
Nov 14 22:45:20 user nova-compute[76815]:         <nova:user uuid="fd20a5a371c7408a89aa50d727527a55">tempest-VolumesActionsTest-1270448896-project-member</nova:user>
Nov 14 22:45:20 user nova-compute[76815]:         <nova:project uuid="c75ce667c7e5443cb8da55c18ebe3270">tempest-VolumesActionsTest-1270448896</nova:project>
Nov 14 22:45:20 user nova-compute[76815]:       </nova:owner>
Nov 14 22:45:20 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:45:20 user nova-compute[76815]:       <nova:ports>
Nov 14 22:45:20 user nova-compute[76815]:         <nova:port uuid="fbda539e-ce2c-4416-a607-931025096d5b">
Nov 14 22:45:20 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 22:45:20 user nova-compute[76815]:         </nova:port>
Nov 14 22:45:20 user nova-compute[76815]:       </nova:ports>
Nov 14 22:45:20 user nova-compute[76815]:     </nova:instance>
Nov 14 22:45:20 user nova-compute[76815]:   </metadata>
Nov 14 22:45:20 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:45:20 user nova-compute[76815]:     <system>
Nov 14 22:45:20 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:45:20 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:45:20 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:45:20 user nova-compute[76815]:       <entry name="serial">3ab30b6f-1bae-444d-97e6-cd74a7099523</entry>
Nov 14 22:45:20 user nova-compute[76815]:       <entry name="uuid">3ab30b6f-1bae-444d-97e6-cd74a7099523</entry>
Nov 14 22:45:20 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:45:20 user nova-compute[76815]:     </system>
Nov 14 22:45:20 user nova-compute[76815]:   </sysinfo>
Nov 14 22:45:20 user nova-compute[76815]:   <os>
Nov 14 22:45:20 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:45:20 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:45:20 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:45:20 user nova-compute[76815]:   </os>
Nov 14 22:45:20 user nova-compute[76815]:   <features>
Nov 14 22:45:20 user nova-compute[76815]:     <acpi/>
Nov 14 22:45:20 user nova-compute[76815]:     <apic/>
Nov 14 22:45:20 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:45:20 user nova-compute[76815]:   </features>
Nov 14 22:45:20 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:45:20 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:45:20 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:45:20 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:45:20 user nova-compute[76815]:   </clock>
Nov 14 22:45:20 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:45:20 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:45:20 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:45:20 user nova-compute[76815]:   </cpu>
Nov 14 22:45:20 user nova-compute[76815]:   <devices>
Nov 14 22:45:20 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:45:20 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:45:20 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk"/>
Nov 14 22:45:20 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:45:20 user nova-compute[76815]:     </disk>
Nov 14 22:45:20 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:45:20 user nova-compute[76815]:       <mac address="fa:16:3e:ab:d5:9d"/>
Nov 14 22:45:20 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:45:20 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:45:20 user nova-compute[76815]:       <target dev="tapfbda539e-ce"/>
Nov 14 22:45:20 user nova-compute[76815]:     </interface>
Nov 14 22:45:20 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:45:20 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/console.log" append="off"/>
Nov 14 22:45:20 user nova-compute[76815]:     </serial>
Nov 14 22:45:20 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:45:20 user nova-compute[76815]:     <video>
Nov 14 22:45:20 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:45:20 user nova-compute[76815]:     </video>
Nov 14 22:45:20 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:45:20 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:45:20 user nova-compute[76815]:     </rng>
Nov 14 22:45:20 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:45:20 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:45:20 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:45:20 user nova-compute[76815]:     </memballoon>
Nov 14 22:45:20 user nova-compute[76815]:   </devices>
Nov 14 22:45:20 user nova-compute[76815]: </domain>
Nov 14 22:45:20 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-356360003',display_name='tempest-VolumesActionsTest-instance-356360003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-356360003',id=49,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c75ce667c7e5443cb8da55c18ebe3270',ramdisk_id='',reservation_id='r-uaispyn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1270448896',owner_user_name='tempest-VolumesActionsTest-1270448896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:45:18Z,user_data=None,user_id='fd20a5a371c7408a89aa50d727527a55',uuid=3ab30b6f-1bae-444d-97e6-cd74a7099523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Converting VIF {"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=fbda539e-ce2c-4416-a607-931025096d5b,network=Network(bea33bfb-175d-464c-9f23-2b46dbf33594),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbda539e-ce') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG os_vif [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=fbda539e-ce2c-4416-a607-931025096d5b,network=Network(bea33bfb-175d-464c-9f23-2b46dbf33594),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbda539e-ce') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fedd3718-2f66-5477-aa14-5c6083a3fbc8', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbda539e-ce, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbda539e-ce, col_values=(('qos', UUID('83f7d74d-6864-4ff4-b966-c9c8a87ce373')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbda539e-ce, col_values=(('external_ids', {'iface-id': 'fbda539e-ce2c-4416-a607-931025096d5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:d5:9d', 'vm-uuid': '3ab30b6f-1bae-444d-97e6-cd74a7099523'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:20 user nova-compute[76815]: INFO os_vif [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=fbda539e-ce2c-4416-a607-931025096d5b,network=Network(bea33bfb-175d-464c-9f23-2b46dbf33594),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbda539e-ce')
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] No VIF found with MAC fa:16:3e:ab:d5:9d, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.network.neutron [req-1b79d608-0c3c-4163-8c60-ec1df0fe492a req-fca629ca-cd10-453a-8905-6dc23119eaca service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Updated VIF entry in instance network info cache for port fbda539e-ce2c-4416-a607-931025096d5b. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG nova.network.neutron [req-1b79d608-0c3c-4163-8c60-ec1df0fe492a req-fca629ca-cd10-453a-8905-6dc23119eaca service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Updating instance_info_cache with network_info: [{"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:45:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-1b79d608-0c3c-4163-8c60-ec1df0fe492a req-fca629ca-cd10-453a-8905-6dc23119eaca service nova] Releasing lock "refresh_cache-3ab30b6f-1bae-444d-97e6-cd74a7099523" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:45:21 user nova-compute[76815]: INFO nova.compute.manager [None req-bb1ab172-6437-4a10-9b38-921f2e73af6d tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Unrescuing
Nov 14 22:45:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb1ab172-6437-4a10-9b38-921f2e73af6d tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb1ab172-6437-4a10-9b38-921f2e73af6d tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquired lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bb1ab172-6437-4a10-9b38-921f2e73af6d tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-f441bb3a-efa0-4173-9124-42b43fffb25f req-f8e4f305-fa0a-48a6-85dd-a0100a8dee4d service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received event network-vif-plugged-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f441bb3a-efa0-4173-9124-42b43fffb25f req-f8e4f305-fa0a-48a6-85dd-a0100a8dee4d service nova] Acquiring lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f441bb3a-efa0-4173-9124-42b43fffb25f req-f8e4f305-fa0a-48a6-85dd-a0100a8dee4d service nova] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f441bb3a-efa0-4173-9124-42b43fffb25f req-f8e4f305-fa0a-48a6-85dd-a0100a8dee4d service nova] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:21 user nova-compute[76815]: DEBUG nova.compute.manager [req-f441bb3a-efa0-4173-9124-42b43fffb25f req-f8e4f305-fa0a-48a6-85dd-a0100a8dee4d service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] No waiting events found dispatching network-vif-plugged-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:45:21 user nova-compute[76815]: WARNING nova.compute.manager [req-f441bb3a-efa0-4173-9124-42b43fffb25f req-f8e4f305-fa0a-48a6-85dd-a0100a8dee4d service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received unexpected event network-vif-plugged-fbda539e-ce2c-4416-a607-931025096d5b for instance with vm_state building and task_state spawning.
Nov 14 22:45:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bb1ab172-6437-4a10-9b38-921f2e73af6d tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb1ab172-6437-4a10-9b38-921f2e73af6d tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Releasing lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bb1ab172-6437-4a10-9b38-921f2e73af6d tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'flavor' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-32be42ce-37c0-4e07-8046-41edb35be3d1 req-01d62a23-2521-494d-ada2-6ed35b6e3058 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-32be42ce-37c0-4e07-8046-41edb35be3d1 req-01d62a23-2521-494d-ada2-6ed35b6e3058 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-32be42ce-37c0-4e07-8046-41edb35be3d1 req-01d62a23-2521-494d-ada2-6ed35b6e3058 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-32be42ce-37c0-4e07-8046-41edb35be3d1 req-01d62a23-2521-494d-ada2-6ed35b6e3058 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-32be42ce-37c0-4e07-8046-41edb35be3d1 req-01d62a23-2521-494d-ada2-6ed35b6e3058 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:45:22 user nova-compute[76815]: WARNING nova.compute.manager [req-32be42ce-37c0-4e07-8046-41edb35be3d1 req-01d62a23-2521-494d-ada2-6ed35b6e3058 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:45:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:23 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Instance destroyed successfully.
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:45:23 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Instance spawned successfully.
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:45:23 user nova-compute[76815]: INFO nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 14 22:45:23 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:45:23 user nova-compute[76815]: INFO nova.compute.manager [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Took 6.08 seconds to build instance.
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4f9b6046-323d-4880-9c0b-164a55852768 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.179s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-3b27b25a-e944-4418-a338-f3b58f8d3cc8 req-5805d81b-4166-406a-aaac-4f185c7926e3 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received event network-vif-plugged-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3b27b25a-e944-4418-a338-f3b58f8d3cc8 req-5805d81b-4166-406a-aaac-4f185c7926e3 service nova] Acquiring lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3b27b25a-e944-4418-a338-f3b58f8d3cc8 req-5805d81b-4166-406a-aaac-4f185c7926e3 service nova] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3b27b25a-e944-4418-a338-f3b58f8d3cc8 req-5805d81b-4166-406a-aaac-4f185c7926e3 service nova] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-3b27b25a-e944-4418-a338-f3b58f8d3cc8 req-5805d81b-4166-406a-aaac-4f185c7926e3 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] No waiting events found dispatching network-vif-plugged-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:45:24 user nova-compute[76815]: WARNING nova.compute.manager [req-3b27b25a-e944-4418-a338-f3b58f8d3cc8 req-5805d81b-4166-406a-aaac-4f185c7926e3 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received unexpected event network-vif-plugged-fbda539e-ce2c-4416-a607-931025096d5b for instance with vm_state active and task_state None.
Nov 14 22:45:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:45:24 user nova-compute[76815]: WARNING nova.compute.manager [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:45:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:45:24 user nova-compute[76815]: WARNING nova.compute.manager [req-37da496f-401b-4f3d-8ccc-96459c5865d2 req-b23c6969-1126-47f6-8fef-c0cc54a1a61f service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:45:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:26 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bb1ab172-6437-4a10-9b38-921f2e73af6d tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:45:26 user nova-compute[76815]: DEBUG nova.compute.manager [req-9dddfe23-ab44-44ae-8850-c4cbcda21d18 req-9c984d57-8e59-462a-a499-08e378b095aa service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:45:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9dddfe23-ab44-44ae-8850-c4cbcda21d18 req-9c984d57-8e59-462a-a499-08e378b095aa service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:45:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9dddfe23-ab44-44ae-8850-c4cbcda21d18 req-9c984d57-8e59-462a-a499-08e378b095aa service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:45:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9dddfe23-ab44-44ae-8850-c4cbcda21d18 req-9c984d57-8e59-462a-a499-08e378b095aa service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:45:26 user nova-compute[76815]: DEBUG nova.compute.manager [req-9dddfe23-ab44-44ae-8850-c4cbcda21d18 req-9c984d57-8e59-462a-a499-08e378b095aa service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:45:26 user nova-compute[76815]: WARNING nova.compute.manager [req-9dddfe23-ab44-44ae-8850-c4cbcda21d18 req-9c984d57-8e59-462a-a499-08e378b095aa service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state rescued and task_state unrescuing.
Nov 14 22:45:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:45:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:03 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:46:03 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=24.972370147705078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance cb981494-6911-4ae9-a88b-3770d7b05049 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3ab30b6f-1bae-444d-97e6-cd74a7099523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:46:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:46:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:46:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:46:04 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updating instance_info_cache with network_info: [{"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-038b8a86-c1ae-43c6-b5ac-d560babe8258" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:46:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:15 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:46:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:46:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:46:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:46:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:46:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:46:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:46:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:46:45 user nova-compute[76815]: INFO nova.compute.claims [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Claim successful on node user
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:46:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.policy [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8f9992958464143ac94c697f6d23920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ed1e318574e63a3153f1661b887f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:46:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Creating image(s)
Nov 14 22:46:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "/opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "/opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "/opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "9f264af710e9016e585f6d0757a33443d4ff3450" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "9f264af710e9016e585f6d0757a33443d4ff3450" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Successfully created port: e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450.part --force-share --output=json" returned: 0 in 0.180s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG nova.virt.images [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] 2d99853e-ce24-4fe1-8395-d1e6463fd33d was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450.part /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450.part /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450.converted" returned: 0 in 0.453s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Successfully updated port: e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquired lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-f7044f60-2fd0-4e6b-809b-f13903223944 req-6611f58f-ab0b-4152-b3a9-bda824760aef service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-f7044f60-2fd0-4e6b-809b-f13903223944 req-6611f58f-ab0b-4152-b3a9-bda824760aef service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing instance network info cache due to event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7044f60-2fd0-4e6b-809b-f13903223944 req-6611f58f-ab0b-4152-b3a9-bda824760aef service nova] Acquiring lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "9f264af710e9016e585f6d0757a33443d4ff3450" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.251s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:46 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450 --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "9f264af710e9016e585f6d0757a33443d4ff3450" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "9f264af710e9016e585f6d0757a33443d4ff3450" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.network.neutron [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Releasing lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Instance network_info: |[{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7044f60-2fd0-4e6b-809b-f13903223944 req-6611f58f-ab0b-4152-b3a9-bda824760aef service nova] Acquired lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.network.neutron [req-f7044f60-2fd0-4e6b-809b-f13903223944 req-6611f58f-ab0b-4152-b3a9-bda824760aef service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450 --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450,backing_fmt=raw /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450,backing_fmt=raw /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk 1073741824" returned: 0 in 0.046s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "9f264af710e9016e585f6d0757a33443d4ff3450" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450 --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.network.neutron [req-f7044f60-2fd0-4e6b-809b-f13903223944 req-6611f58f-ab0b-4152-b3a9-bda824760aef service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updated VIF entry in instance network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.network.neutron [req-f7044f60-2fd0-4e6b-809b-f13903223944 req-6611f58f-ab0b-4152-b3a9-bda824760aef service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f7044f60-2fd0-4e6b-809b-f13903223944 req-6611f58f-ab0b-4152-b3a9-bda824760aef service nova] Releasing lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Cannot resize image /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Ensure instance console log exists: /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Start _get_guest_xml network_info=[{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:46:42Z,direct_url=<?>,disk_format='qcow2',id=2d99853e-ce24-4fe1-8395-d1e6463fd33d,min_disk=0,min_ram=0,name='tempest-scenario-img--1455743276',owner='769ed1e318574e63a3153f1661b887f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:46:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '2d99853e-ce24-4fe1-8395-d1e6463fd33d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:46:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:46:47 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:46:42Z,direct_url=<?>,disk_format='qcow2',id=2d99853e-ce24-4fe1-8395-d1e6463fd33d,min_disk=0,min_ram=0,name='tempest-scenario-img--1455743276',owner='769ed1e318574e63a3153f1661b887f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:46:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-195768833',display_name='tempest-TestMinimumBasicScenario-server-195768833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-195768833',id=50,image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLmhTJIJLVi3HmyN1E0yCRmhtxQ5+3uyg6nDP16MxilwWlIFe850K/hLeDBpU2lpCEcPQk6CaTTe3m/ZjCM2PNLLlG0F7TWuudKfnuWMKbU5utOdalqEngCERkL3wb2Ww==',key_name='tempest-TestMinimumBasicScenario-1998403551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='769ed1e318574e63a3153f1661b887f2',ramdisk_id='',reservation_id='r-o85sjwda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546482846',owner_user_name='tempest-TestMinimumBasicScenario-546482846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:46:46Z,user_data=None,user_id='b8f9992958464143ac94c697f6d23920',uuid=44f05803-a6e1-4ceb-bbc5-97e343c2bc25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converting VIF {"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.objects.instance [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'pci_devices' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:46:47 user nova-compute[76815]:   <uuid>44f05803-a6e1-4ceb-bbc5-97e343c2bc25</uuid>
Nov 14 22:46:47 user nova-compute[76815]:   <name>instance-00000032</name>
Nov 14 22:46:47 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:46:47 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:46:47 user nova-compute[76815]:   <metadata>
Nov 14 22:46:47 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:46:47 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:46:47 user nova-compute[76815]:       <nova:name>tempest-TestMinimumBasicScenario-server-195768833</nova:name>
Nov 14 22:46:47 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:46:47</nova:creationTime>
Nov 14 22:46:47 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:46:47 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:46:47 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:46:47 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:46:47 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:46:47 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:46:47 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:46:47 user nova-compute[76815]:       <nova:owner>
Nov 14 22:46:47 user nova-compute[76815]:         <nova:user uuid="b8f9992958464143ac94c697f6d23920">tempest-TestMinimumBasicScenario-546482846-project-member</nova:user>
Nov 14 22:46:47 user nova-compute[76815]:         <nova:project uuid="769ed1e318574e63a3153f1661b887f2">tempest-TestMinimumBasicScenario-546482846</nova:project>
Nov 14 22:46:47 user nova-compute[76815]:       </nova:owner>
Nov 14 22:46:47 user nova-compute[76815]:       <nova:root type="image" uuid="2d99853e-ce24-4fe1-8395-d1e6463fd33d"/>
Nov 14 22:46:47 user nova-compute[76815]:       <nova:ports>
Nov 14 22:46:47 user nova-compute[76815]:         <nova:port uuid="e46efeef-6f27-406b-89df-2b488d6f8626">
Nov 14 22:46:47 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 22:46:47 user nova-compute[76815]:         </nova:port>
Nov 14 22:46:47 user nova-compute[76815]:       </nova:ports>
Nov 14 22:46:47 user nova-compute[76815]:     </nova:instance>
Nov 14 22:46:47 user nova-compute[76815]:   </metadata>
Nov 14 22:46:47 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:46:47 user nova-compute[76815]:     <system>
Nov 14 22:46:47 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:46:47 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:46:47 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:46:47 user nova-compute[76815]:       <entry name="serial">44f05803-a6e1-4ceb-bbc5-97e343c2bc25</entry>
Nov 14 22:46:47 user nova-compute[76815]:       <entry name="uuid">44f05803-a6e1-4ceb-bbc5-97e343c2bc25</entry>
Nov 14 22:46:47 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:46:47 user nova-compute[76815]:     </system>
Nov 14 22:46:47 user nova-compute[76815]:   </sysinfo>
Nov 14 22:46:47 user nova-compute[76815]:   <os>
Nov 14 22:46:47 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:46:47 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:46:47 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:46:47 user nova-compute[76815]:   </os>
Nov 14 22:46:47 user nova-compute[76815]:   <features>
Nov 14 22:46:47 user nova-compute[76815]:     <acpi/>
Nov 14 22:46:47 user nova-compute[76815]:     <apic/>
Nov 14 22:46:47 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:46:47 user nova-compute[76815]:   </features>
Nov 14 22:46:47 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:46:47 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:46:47 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:46:47 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:46:47 user nova-compute[76815]:   </clock>
Nov 14 22:46:47 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:46:47 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:46:47 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:46:47 user nova-compute[76815]:   </cpu>
Nov 14 22:46:47 user nova-compute[76815]:   <devices>
Nov 14 22:46:47 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:46:47 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:46:47 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk"/>
Nov 14 22:46:47 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:46:47 user nova-compute[76815]:     </disk>
Nov 14 22:46:47 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:46:47 user nova-compute[76815]:       <mac address="fa:16:3e:21:cd:75"/>
Nov 14 22:46:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:46:47 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:46:47 user nova-compute[76815]:       <target dev="tape46efeef-6f"/>
Nov 14 22:46:47 user nova-compute[76815]:     </interface>
Nov 14 22:46:47 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:46:47 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/console.log" append="off"/>
Nov 14 22:46:47 user nova-compute[76815]:     </serial>
Nov 14 22:46:47 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:46:47 user nova-compute[76815]:     <video>
Nov 14 22:46:47 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:46:47 user nova-compute[76815]:     </video>
Nov 14 22:46:47 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:46:47 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:46:47 user nova-compute[76815]:     </rng>
Nov 14 22:46:47 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:46:47 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:46:47 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:46:47 user nova-compute[76815]:     </memballoon>
Nov 14 22:46:47 user nova-compute[76815]:   </devices>
Nov 14 22:46:47 user nova-compute[76815]: </domain>
Nov 14 22:46:47 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-195768833',display_name='tempest-TestMinimumBasicScenario-server-195768833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-195768833',id=50,image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLmhTJIJLVi3HmyN1E0yCRmhtxQ5+3uyg6nDP16MxilwWlIFe850K/hLeDBpU2lpCEcPQk6CaTTe3m/ZjCM2PNLLlG0F7TWuudKfnuWMKbU5utOdalqEngCERkL3wb2Ww==',key_name='tempest-TestMinimumBasicScenario-1998403551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='769ed1e318574e63a3153f1661b887f2',ramdisk_id='',reservation_id='r-o85sjwda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546482846',owner_user_name='tempest-TestMinimumBasicScenario-546482846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:46:46Z,user_data=None,user_id='b8f9992958464143ac94c697f6d23920',uuid=44f05803-a6e1-4ceb-bbc5-97e343c2bc25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converting VIF {"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG os_vif [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '301535b2-3368-502d-9084-4c69c3fa82e4', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape46efeef-6f, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape46efeef-6f, col_values=(('qos', UUID('a151a2dc-a2d3-41f4-88d7-6bf3168344ad')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape46efeef-6f, col_values=(('external_ids', {'iface-id': 'e46efeef-6f27-406b-89df-2b488d6f8626', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:cd:75', 'vm-uuid': '44f05803-a6e1-4ceb-bbc5-97e343c2bc25'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:47 user nova-compute[76815]: INFO os_vif [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f')
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No VIF found with MAC fa:16:3e:21:cd:75, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:46:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-c7cbd0d0-1c7b-4577-b78c-8d882cbd849c req-3dfc5b30-9ed4-4c3a-a9ae-8b9ad2a25ee4 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c7cbd0d0-1c7b-4577-b78c-8d882cbd849c req-3dfc5b30-9ed4-4c3a-a9ae-8b9ad2a25ee4 service nova] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c7cbd0d0-1c7b-4577-b78c-8d882cbd849c req-3dfc5b30-9ed4-4c3a-a9ae-8b9ad2a25ee4 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-c7cbd0d0-1c7b-4577-b78c-8d882cbd849c req-3dfc5b30-9ed4-4c3a-a9ae-8b9ad2a25ee4 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG nova.compute.manager [req-c7cbd0d0-1c7b-4577-b78c-8d882cbd849c req-3dfc5b30-9ed4-4c3a-a9ae-8b9ad2a25ee4 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] No waiting events found dispatching network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:46:49 user nova-compute[76815]: WARNING nova.compute.manager [req-c7cbd0d0-1c7b-4577-b78c-8d882cbd849c req-3dfc5b30-9ed4-4c3a-a9ae-8b9ad2a25ee4 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received unexpected event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 for instance with vm_state building and task_state spawning.
Nov 14 22:46:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:46:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Instance spawned successfully.
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:46:51 user nova-compute[76815]: INFO nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:46:51 user nova-compute[76815]: INFO nova.compute.manager [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Took 6.37 seconds to build instance.
Nov 14 22:46:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-bb306fe2-7ebd-4453-9aab-03798427ec6e tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.461s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-01e88f91-f2b2-4a04-bc86-42620d15477a req-13f823b7-c338-465d-935b-da1220db36e8 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-01e88f91-f2b2-4a04-bc86-42620d15477a req-13f823b7-c338-465d-935b-da1220db36e8 service nova] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-01e88f91-f2b2-4a04-bc86-42620d15477a req-13f823b7-c338-465d-935b-da1220db36e8 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-01e88f91-f2b2-4a04-bc86-42620d15477a req-13f823b7-c338-465d-935b-da1220db36e8 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:46:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-01e88f91-f2b2-4a04-bc86-42620d15477a req-13f823b7-c338-465d-935b-da1220db36e8 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] No waiting events found dispatching network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:46:51 user nova-compute[76815]: WARNING nova.compute.manager [req-01e88f91-f2b2-4a04-bc86-42620d15477a req-13f823b7-c338-465d-935b-da1220db36e8 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received unexpected event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 for instance with vm_state active and task_state None.
Nov 14 22:46:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:46:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:01 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:47:02 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:03 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:47:03 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8562MB free_disk=24.899879455566406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance cb981494-6911-4ae9-a88b-3770d7b05049 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 3ab30b6f-1bae-444d-97e6-cd74a7099523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:47:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:47:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:47:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:47:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:47:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:47:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:47:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:47:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:47:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:47:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:47:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:47:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:47:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:47:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:47:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:47:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:47:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:47:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:47:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:47:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquiring lock "3ab30b6f-1bae-444d-97e6-cd74a7099523" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquiring lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:47:12 user nova-compute[76815]: INFO nova.compute.manager [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Terminating instance
Nov 14 22:47:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-4d2f5079-4711-4288-b7d7-1afe65cbf54f req-332e9795-bf9a-4597-afcf-786bf9ba8f92 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received event network-vif-unplugged-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4d2f5079-4711-4288-b7d7-1afe65cbf54f req-332e9795-bf9a-4597-afcf-786bf9ba8f92 service nova] Acquiring lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4d2f5079-4711-4288-b7d7-1afe65cbf54f req-332e9795-bf9a-4597-afcf-786bf9ba8f92 service nova] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-4d2f5079-4711-4288-b7d7-1afe65cbf54f req-332e9795-bf9a-4597-afcf-786bf9ba8f92 service nova] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-4d2f5079-4711-4288-b7d7-1afe65cbf54f req-332e9795-bf9a-4597-afcf-786bf9ba8f92 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] No waiting events found dispatching network-vif-unplugged-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:47:12 user nova-compute[76815]: DEBUG nova.compute.manager [req-4d2f5079-4711-4288-b7d7-1afe65cbf54f req-332e9795-bf9a-4597-afcf-786bf9ba8f92 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received event network-vif-unplugged-fbda539e-ce2c-4416-a607-931025096d5b for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Instance destroyed successfully.
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.objects.instance [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lazy-loading 'resources' on Instance uuid 3ab30b6f-1bae-444d-97e6-cd74a7099523 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-356360003',display_name='tempest-VolumesActionsTest-instance-356360003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-356360003',id=49,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:45:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c75ce667c7e5443cb8da55c18ebe3270',ramdisk_id='',reservation_id='r-uaispyn8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1270448896',owner_user_name='tempest-VolumesActionsTest-1270448896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:45:24Z,user_data=None,user_id='fd20a5a371c7408a89aa50d727527a55',uuid=3ab30b6f-1bae-444d-97e6-cd74a7099523,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Converting VIF {"id": "fbda539e-ce2c-4416-a607-931025096d5b", "address": "fa:16:3e:ab:d5:9d", "network": {"id": "bea33bfb-175d-464c-9f23-2b46dbf33594", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1783396256-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c75ce667c7e5443cb8da55c18ebe3270", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbda539e-ce", "ovs_interfaceid": "fbda539e-ce2c-4416-a607-931025096d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=fbda539e-ce2c-4416-a607-931025096d5b,network=Network(bea33bfb-175d-464c-9f23-2b46dbf33594),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbda539e-ce') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG os_vif [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=fbda539e-ce2c-4416-a607-931025096d5b,network=Network(bea33bfb-175d-464c-9f23-2b46dbf33594),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbda539e-ce') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbda539e-ce, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83f7d74d-6864-4ff4-b966-c9c8a87ce373) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:47:13 user nova-compute[76815]: INFO os_vif [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:d5:9d,bridge_name='br-int',has_traffic_filtering=True,id=fbda539e-ce2c-4416-a607-931025096d5b,network=Network(bea33bfb-175d-464c-9f23-2b46dbf33594),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbda539e-ce')
Nov 14 22:47:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Deleting instance files /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523_del
Nov 14 22:47:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Deletion of /opt/stack/data/nova/instances/3ab30b6f-1bae-444d-97e6-cd74a7099523_del complete
Nov 14 22:47:13 user nova-compute[76815]: INFO nova.compute.manager [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 22:47:13 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:47:13 user nova-compute[76815]: INFO nova.compute.manager [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Detaching volume d118eb44-e247-4748-b380-0bf02c529f7f
Nov 14 22:47:13 user nova-compute[76815]: INFO nova.virt.block_device [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Attempting to driver detach volume d118eb44-e247-4748-b380-0bf02c529f7f from mountpoint /dev/vdb
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Attempting to detach device vdb from instance cb981494-6911-4ae9-a88b-3770d7b05049 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:47:13 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:47:13 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:47:13 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:47:13 user nova-compute[76815]:   <serial>d118eb44-e247-4748-b380-0bf02c529f7f</serial>
Nov 14 22:47:13 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:47:13 user nova-compute[76815]: </disk>
Nov 14 22:47:13 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:47:13 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Successfully detached device vdb from instance cb981494-6911-4ae9-a88b-3770d7b05049 from the persistent domain config.
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb981494-6911-4ae9-a88b-3770d7b05049 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:47:13 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:47:13 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:47:13 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:47:13 user nova-compute[76815]:   <serial>d118eb44-e247-4748-b380-0bf02c529f7f</serial>
Nov 14 22:47:13 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:47:13 user nova-compute[76815]: </disk>
Nov 14 22:47:13 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:47:13 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Took 0.44 seconds to deallocate network for instance.
Nov 14 22:47:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:47:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:47:14 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Deleted allocations for instance 3ab30b6f-1bae-444d-97e6-cd74a7099523
Nov 14 22:47:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-91137571-2f6d-45d2-bd4d-747fa09e4e74 tempest-VolumesActionsTest-1270448896 tempest-VolumesActionsTest-1270448896-project-member] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.681s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received event network-vif-plugged-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] Acquiring lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] Lock "3ab30b6f-1bae-444d-97e6-cd74a7099523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] No waiting events found dispatching network-vif-plugged-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:47:14 user nova-compute[76815]: WARNING nova.compute.manager [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received unexpected event network-vif-plugged-fbda539e-ce2c-4416-a607-931025096d5b for instance with vm_state deleted and task_state None.
Nov 14 22:47:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-changed-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG nova.compute.manager [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Refreshing instance network info cache due to event network-changed-35df3788-4c76-4df0-b7f2-ae06436f800d. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] Acquiring lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] Acquired lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:47:14 user nova-compute[76815]: DEBUG nova.network.neutron [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Refreshing network info cache for port 35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:47:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updated VIF entry in instance network info cache for port 35df3788-4c76-4df0-b7f2-ae06436f800d. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:47:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:47:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] Releasing lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:47:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-changed-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:47:15 user nova-compute[76815]: DEBUG nova.compute.manager [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Refreshing instance network info cache due to event network-changed-35df3788-4c76-4df0-b7f2-ae06436f800d. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:47:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] Acquiring lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:47:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] Acquired lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:47:15 user nova-compute[76815]: DEBUG nova.network.neutron [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Refreshing network info cache for port 35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:47:16 user nova-compute[76815]: DEBUG nova.network.neutron [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updated VIF entry in instance network info cache for port 35df3788-4c76-4df0-b7f2-ae06436f800d. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:47:16 user nova-compute[76815]: DEBUG nova.network.neutron [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [{"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:47:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:47:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] Releasing lock "refresh_cache-cb981494-6911-4ae9-a88b-3770d7b05049" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:47:16 user nova-compute[76815]: DEBUG nova.compute.manager [req-f4e4a229-bc79-4408-b987-83863c5bfea9 req-63d7aaf1-c879-4f63-bbda-781acd979cb7 service nova] [instance: 3ab30b6f-1bae-444d-97e6-cd74a7099523] Received event network-vif-deleted-fbda539e-ce2c-4416-a607-931025096d5b {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:47:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:47:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:47:34 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cb981494-6911-4ae9-a88b-3770d7b05049 is timed out.
Nov 14 22:47:34 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Successfully detached device vdb from instance cb981494-6911-4ae9-a88b-3770d7b05049 from the live domain config.
Nov 14 22:47:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZwgxGPd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:47:34 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[33928763-6482-4a8a-95f4-15194bd32f34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:47:34 user nova-compute[76815]: No targets found.
Nov 14 22:47:34 user nova-compute[76815]: iSNS:
Nov 14 22:47:34 user nova-compute[76815]: No targets found.
Nov 14 22:47:34 user nova-compute[76815]: STATIC:
Nov 14 22:47:34 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f
Nov 14 22:47:34 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:47:34 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:47:34 user nova-compute[76815]: FIRMWARE:
Nov 14 22:47:34 user nova-compute[76815]: No targets found.
Nov 14 22:47:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:47:34 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:47:34 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a0b2f-a895-472e-bda3-131a9de06fe7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8832b90-c2c9-4237-b54e-a3cf81a16205]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:47:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f (non-flash)
Nov 14 22:47:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4536a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cf14d8-104d-4c2b-96c7-090932eff9ee]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5902eef7-0840-44e9-a35d-9a712a3a2d5a]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[515fa64f-2947-42f1-b221-3a41a29f4da5]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[188f7b7f-fac7-4826-90d6-51b7658e6155]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c1696d-98e8-41a9-b9e2-d134632d9f6e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c2f7a-a534-488c-9dca-99767eab2e61]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f, portal: 172.16.0.220,3260]
Nov 14 22:47:34 user nova-compute[76815]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f, portal: 172.16.0.220,3260] successful.
Nov 14 22:47:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d118eb44-e247-4748-b380-0bf02c529f7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f032abe-df3a-42d9-9da5-b8b8a697c599]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] <== disconnect_volume: return (291ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:47:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:47:35 user nova-compute[76815]: DEBUG nova.objects.instance [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'flavor' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:47:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-63ab377c-f639-46a8-9a27-69245c9beed5 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.631s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:47:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:47:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:47:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:47:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:47:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:47:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:47:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:03 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:04 user nova-compute[76815]: INFO nova.compute.manager [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Terminating instance
Nov 14 22:48:04 user nova-compute[76815]: DEBUG nova.compute.manager [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-3020d077-370f-477d-8084-54d71760d186 req-3606c447-80db-4c3a-a911-09343308e6a1 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3020d077-370f-477d-8084-54d71760d186 req-3606c447-80db-4c3a-a911-09343308e6a1 service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3020d077-370f-477d-8084-54d71760d186 req-3606c447-80db-4c3a-a911-09343308e6a1 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3020d077-370f-477d-8084-54d71760d186 req-3606c447-80db-4c3a-a911-09343308e6a1 service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-3020d077-370f-477d-8084-54d71760d186 req-3606c447-80db-4c3a-a911-09343308e6a1 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG nova.compute.manager [req-3020d077-370f-477d-8084-54d71760d186 req-3606c447-80db-4c3a-a911-09343308e6a1 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-unplugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Instance destroyed successfully.
Nov 14 22:48:04 user nova-compute[76815]: DEBUG nova.objects.instance [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'resources' on Instance uuid cb981494-6911-4ae9-a88b-3770d7b05049 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1301907907',display_name='tempest-ServerRescueNegativeTestJSON-server-1301907907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1301907907',id=47,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGWgPVNwI8DhuqwOjdohDACPc5+dcRRRpmNT48qpO7BhRQxWDcHA5eWe6UINmc1InAGk07XfG40k/ye14BWaCMwLoGZfZ3e32c8lwL2fWVdFf5fPoiTEe2PWh+/kGb6Kg==',key_name='tempest-keypair-1284410080',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-35oa0v8p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=cb981494-6911-4ae9-a88b-3770d7b05049,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "35df3788-4c76-4df0-b7f2-ae06436f800d", "address": "fa:16:3e:1b:60:80", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35df3788-4c", "ovs_interfaceid": "35df3788-4c76-4df0-b7f2-ae06436f800d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:60:80,bridge_name='br-int',has_traffic_filtering=True,id=35df3788-4c76-4df0-b7f2-ae06436f800d,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35df3788-4c') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG os_vif [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:60:80,bridge_name='br-int',has_traffic_filtering=True,id=35df3788-4c76-4df0-b7f2-ae06436f800d,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35df3788-4c') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35df3788-4c, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3168ac24-be93-463e-b233-01d6a16f0e4a) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:48:04 user nova-compute[76815]: INFO os_vif [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:60:80,bridge_name='br-int',has_traffic_filtering=True,id=35df3788-4c76-4df0-b7f2-ae06436f800d,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35df3788-4c')
Nov 14 22:48:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Deleting instance files /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049_del
Nov 14 22:48:04 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Deletion of /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049_del complete
Nov 14 22:48:05 user nova-compute[76815]: INFO nova.compute.manager [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 22:48:05 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json" returned: 1 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk --force-share --output=json' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:48:05 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002f, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/cb981494-6911-4ae9-a88b-3770d7b05049/disk
Nov 14 22:48:05 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:48:05 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8623MB free_disk=24.898788452148438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 038b8a86-c1ae-43c6-b5ac-d560babe8258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance cb981494-6911-4ae9-a88b-3770d7b05049 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:48:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:48:06 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Took 1.10 seconds to deallocate network for instance.
Nov 14 22:48:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-a3996f40-b971-4e8d-b88c-97c6564f6c76 req-6114baa6-ec65-4ee2-993b-b0d44ba45aa4 service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-deleted-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:06 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Deleted allocations for instance cb981494-6911-4ae9-a88b-3770d7b05049
Nov 14 22:48:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1f79add3-053b-4b8c-8f5d-3fc81e3a8100 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "cb981494-6911-4ae9-a88b-3770d7b05049" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.429s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-5dcc28c2-83e7-423d-b55a-1dd0d0709889 req-a2faf669-3f8b-43fb-9a64-5597f3743b7b service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5dcc28c2-83e7-423d-b55a-1dd0d0709889 req-a2faf669-3f8b-43fb-9a64-5597f3743b7b service nova] Acquiring lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5dcc28c2-83e7-423d-b55a-1dd0d0709889 req-a2faf669-3f8b-43fb-9a64-5597f3743b7b service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-5dcc28c2-83e7-423d-b55a-1dd0d0709889 req-a2faf669-3f8b-43fb-9a64-5597f3743b7b service nova] Lock "cb981494-6911-4ae9-a88b-3770d7b05049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG nova.compute.manager [req-5dcc28c2-83e7-423d-b55a-1dd0d0709889 req-a2faf669-3f8b-43fb-9a64-5597f3743b7b service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] No waiting events found dispatching network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:48:06 user nova-compute[76815]: WARNING nova.compute.manager [req-5dcc28c2-83e7-423d-b55a-1dd0d0709889 req-a2faf669-3f8b-43fb-9a64-5597f3743b7b service nova] [instance: cb981494-6911-4ae9-a88b-3770d7b05049] Received unexpected event network-vif-plugged-35df3788-4c76-4df0-b7f2-ae06436f800d for instance with vm_state deleted and task_state None.
Nov 14 22:48:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:06 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:48:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:17 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:30 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:48:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'flavor' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:37 user nova-compute[76815]: INFO nova.compute.manager [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Attaching volume 81b756a6-2f29-48a4-865a-dfa7742fa8af to /dev/vdb
Nov 14 22:48:37 user nova-compute[76815]: DEBUG os_brick.utils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6852f6c-921a-47d9-a64c-0988a0a58923]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ab031a-37f3-4f1f-a816-32f3cca63591]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b99c7d9-4b0d-422a-ab4b-132313a74383]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8702059-301a-4b88-8996-8a8a88e3df9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:48:37 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:48:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b9c349-a99d-4663-b4db-ff0bfdd15fbf]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG os_brick.utils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating existing volume attachment record: 93ac97ff-9c7e-427e-8675-101c4bd12f82 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:48:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUIoHjFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:48:42 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:48:42 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:48:42 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5bfdcd-441a-47c4-8364-f60e93155c78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:48:42 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f36dfe-6f33-4f60-98d4-99beb944ee17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af] added
Nov 14 22:48:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ded174-ba79-4c7d-9e6d-a05183a7a02d]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eb026f-621b-437d-a7c6-848d6b0ceaf8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUIoHjFS {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUIoHjFS" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1432a565-d1e9-451b-8fa1-6ae949e62f8e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RUIoHjFS'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c235eda-99b6-4398-b540-fa9ce9ab2185]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba9be74-ed00-471e-a758-3239b6f5a39d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:48:42 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:48:42 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:48:42 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:48:42 user nova-compute[76815]: 
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad31281f-b387-4f1b-b4af-7e5aab6f8aad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260]
Nov 14 22:48:42 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260] successful.
Nov 14 22:48:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[63132289-08a3-4770-9cfd-18f083bd6206]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7758f424-81c0-485d-8bf6-f83a60ef2d5e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:48:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:48:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1494f6e2-dd23-4ecb-b22c-3f4ebd922f4f]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUIoHjFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:48:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:48:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23138323632353362', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:48:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138323632353362', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:48:43 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'flavor' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:48:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:48:43 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:48:43 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:48:43 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:48:43 user nova-compute[76815]:   <serial>81b756a6-2f29-48a4-865a-dfa7742fa8af</serial>
Nov 14 22:48:43 user nova-compute[76815]: </disk>
Nov 14 22:48:43 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:48:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:48:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:48:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No VIF found with MAC fa:16:3e:21:cd:75, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f25b38d7-540e-4c98-a17f-341248fe7585 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.643s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:48:44 user nova-compute[76815]: INFO nova.compute.claims [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Claim successful on node user
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:48:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.policy [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '625d6e10a8c947c1b12d1177c38dbad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f86231e39e6405ea7ce2a1e499e2be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:48:44 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Creating image(s)
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "/opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "/opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.192s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.171s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk 1073741824" returned: 0 in 0.064s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Successfully created port: 4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Cannot resize image /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Ensure instance console log exists: /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:45 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Successfully updated port: 4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquired lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-e2d75b59-ee85-4920-8e46-2803acd256c6 req-36a40bf6-e019-43d0-b5f1-40af0a00eeec service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received event network-changed-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.compute.manager [req-e2d75b59-ee85-4920-8e46-2803acd256c6 req-36a40bf6-e019-43d0-b5f1-40af0a00eeec service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Refreshing instance network info cache due to event network-changed-4a8c65d8-764c-4e40-aefe-3dca6f7c97db. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e2d75b59-ee85-4920-8e46-2803acd256c6 req-36a40bf6-e019-43d0-b5f1-40af0a00eeec service nova] Acquiring lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.neutron [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating instance_info_cache with network_info: [{"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Releasing lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Instance network_info: |[{"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e2d75b59-ee85-4920-8e46-2803acd256c6 req-36a40bf6-e019-43d0-b5f1-40af0a00eeec service nova] Acquired lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-e2d75b59-ee85-4920-8e46-2803acd256c6 req-36a40bf6-e019-43d0-b5f1-40af0a00eeec service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Refreshing network info cache for port 4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Start _get_guest_xml network_info=[{"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:48:46 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:48:46 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1444452786',display_name='tempest-SnapshotDataIntegrityTests-server-1444452786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1444452786',id=51,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwV55HmjY+tcxcSX3rd2reTN/UF/Qss1XOW3/MahUllQjnZPeQpCCUDy8/u1imaZrIrMDJtGiAvULbUuqNnxmBJLmyNH6IO+i3/MKemXSYAEXYzvkLINKKHkVGJOnSjPg==',key_name='tempest-keypair-1298659560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f86231e39e6405ea7ce2a1e499e2be8',ramdisk_id='',reservation_id='r-jeeh6hsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-489212323',owner_user_name='tempest-SnapshotDataIntegrityTests-489212323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625d6e10a8c947c1b12d1177c38dbad3',uuid=ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Converting VIF {"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=4a8c65d8-764c-4e40-aefe-3dca6f7c97db,network=Network(83326788-46d4-4a0c-9859-a413166c4d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8c65d8-76') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'pci_devices' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:48:46 user nova-compute[76815]:   <uuid>ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa</uuid>
Nov 14 22:48:46 user nova-compute[76815]:   <name>instance-00000033</name>
Nov 14 22:48:46 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:48:46 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:48:46 user nova-compute[76815]:   <metadata>
Nov 14 22:48:46 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:48:46 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:48:46 user nova-compute[76815]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1444452786</nova:name>
Nov 14 22:48:46 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:48:46</nova:creationTime>
Nov 14 22:48:46 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:48:46 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:48:46 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:48:46 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:48:46 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:48:46 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:48:46 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:48:46 user nova-compute[76815]:       <nova:owner>
Nov 14 22:48:46 user nova-compute[76815]:         <nova:user uuid="625d6e10a8c947c1b12d1177c38dbad3">tempest-SnapshotDataIntegrityTests-489212323-project-member</nova:user>
Nov 14 22:48:46 user nova-compute[76815]:         <nova:project uuid="1f86231e39e6405ea7ce2a1e499e2be8">tempest-SnapshotDataIntegrityTests-489212323</nova:project>
Nov 14 22:48:46 user nova-compute[76815]:       </nova:owner>
Nov 14 22:48:46 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:48:46 user nova-compute[76815]:       <nova:ports>
Nov 14 22:48:46 user nova-compute[76815]:         <nova:port uuid="4a8c65d8-764c-4e40-aefe-3dca6f7c97db">
Nov 14 22:48:46 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 22:48:46 user nova-compute[76815]:         </nova:port>
Nov 14 22:48:46 user nova-compute[76815]:       </nova:ports>
Nov 14 22:48:46 user nova-compute[76815]:     </nova:instance>
Nov 14 22:48:46 user nova-compute[76815]:   </metadata>
Nov 14 22:48:46 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:48:46 user nova-compute[76815]:     <system>
Nov 14 22:48:46 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:48:46 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:48:46 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:48:46 user nova-compute[76815]:       <entry name="serial">ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa</entry>
Nov 14 22:48:46 user nova-compute[76815]:       <entry name="uuid">ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa</entry>
Nov 14 22:48:46 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:48:46 user nova-compute[76815]:     </system>
Nov 14 22:48:46 user nova-compute[76815]:   </sysinfo>
Nov 14 22:48:46 user nova-compute[76815]:   <os>
Nov 14 22:48:46 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:48:46 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:48:46 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:48:46 user nova-compute[76815]:   </os>
Nov 14 22:48:46 user nova-compute[76815]:   <features>
Nov 14 22:48:46 user nova-compute[76815]:     <acpi/>
Nov 14 22:48:46 user nova-compute[76815]:     <apic/>
Nov 14 22:48:46 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:48:46 user nova-compute[76815]:   </features>
Nov 14 22:48:46 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:48:46 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:48:46 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:48:46 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:48:46 user nova-compute[76815]:   </clock>
Nov 14 22:48:46 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:48:46 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:48:46 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:48:46 user nova-compute[76815]:   </cpu>
Nov 14 22:48:46 user nova-compute[76815]:   <devices>
Nov 14 22:48:46 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:48:46 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:48:46 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk"/>
Nov 14 22:48:46 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:48:46 user nova-compute[76815]:     </disk>
Nov 14 22:48:46 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:48:46 user nova-compute[76815]:       <mac address="fa:16:3e:40:2f:bb"/>
Nov 14 22:48:46 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:48:46 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:48:46 user nova-compute[76815]:       <target dev="tap4a8c65d8-76"/>
Nov 14 22:48:46 user nova-compute[76815]:     </interface>
Nov 14 22:48:46 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:48:46 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/console.log" append="off"/>
Nov 14 22:48:46 user nova-compute[76815]:     </serial>
Nov 14 22:48:46 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:48:46 user nova-compute[76815]:     <video>
Nov 14 22:48:46 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:48:46 user nova-compute[76815]:     </video>
Nov 14 22:48:46 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:48:46 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:48:46 user nova-compute[76815]:     </rng>
Nov 14 22:48:46 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:48:46 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:48:46 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:48:46 user nova-compute[76815]:     </memballoon>
Nov 14 22:48:46 user nova-compute[76815]:   </devices>
Nov 14 22:48:46 user nova-compute[76815]: </domain>
Nov 14 22:48:46 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1444452786',display_name='tempest-SnapshotDataIntegrityTests-server-1444452786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1444452786',id=51,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwV55HmjY+tcxcSX3rd2reTN/UF/Qss1XOW3/MahUllQjnZPeQpCCUDy8/u1imaZrIrMDJtGiAvULbUuqNnxmBJLmyNH6IO+i3/MKemXSYAEXYzvkLINKKHkVGJOnSjPg==',key_name='tempest-keypair-1298659560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f86231e39e6405ea7ce2a1e499e2be8',ramdisk_id='',reservation_id='r-jeeh6hsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-489212323',owner_user_name='tempest-SnapshotDataIntegrityTests-489212323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625d6e10a8c947c1b12d1177c38dbad3',uuid=ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Converting VIF {"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=4a8c65d8-764c-4e40-aefe-3dca6f7c97db,network=Network(83326788-46d4-4a0c-9859-a413166c4d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8c65d8-76') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG os_vif [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=4a8c65d8-764c-4e40-aefe-3dca6f7c97db,network=Network(83326788-46d4-4a0c-9859-a413166c4d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8c65d8-76') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '006283ff-77a3-5e0d-9c6e-7231562b098a', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a8c65d8-76, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a8c65d8-76, col_values=(('qos', UUID('1ba5c43a-3acb-4d18-a308-17838b45041b')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a8c65d8-76, col_values=(('external_ids', {'iface-id': '4a8c65d8-764c-4e40-aefe-3dca6f7c97db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:2f:bb', 'vm-uuid': 'ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:46 user nova-compute[76815]: INFO os_vif [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=4a8c65d8-764c-4e40-aefe-3dca6f7c97db,network=Network(83326788-46d4-4a0c-9859-a413166c4d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8c65d8-76')
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No VIF found with MAC fa:16:3e:40:2f:bb, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-e2d75b59-ee85-4920-8e46-2803acd256c6 req-36a40bf6-e019-43d0-b5f1-40af0a00eeec service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updated VIF entry in instance network info cache for port 4a8c65d8-764c-4e40-aefe-3dca6f7c97db. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG nova.network.neutron [req-e2d75b59-ee85-4920-8e46-2803acd256c6 req-36a40bf6-e019-43d0-b5f1-40af0a00eeec service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating instance_info_cache with network_info: [{"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:48:46 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e2d75b59-ee85-4920-8e46-2803acd256c6 req-36a40bf6-e019-43d0-b5f1-40af0a00eeec service nova] Releasing lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:48:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-70344a78-2eab-42f2-b553-0295d67389fb req-11df8138-1528-48a6-ac7f-fca9e840a8aa service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-70344a78-2eab-42f2-b553-0295d67389fb req-11df8138-1528-48a6-ac7f-fca9e840a8aa service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing instance network info cache due to event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-70344a78-2eab-42f2-b553-0295d67389fb req-11df8138-1528-48a6-ac7f-fca9e840a8aa service nova] Acquiring lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-70344a78-2eab-42f2-b553-0295d67389fb req-11df8138-1528-48a6-ac7f-fca9e840a8aa service nova] Acquired lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-70344a78-2eab-42f2-b553-0295d67389fb req-11df8138-1528-48a6-ac7f-fca9e840a8aa service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-3aca911f-cba6-4e67-a26d-22b59306fe25 req-a57f220b-c204-4470-9f9d-252fd16a13b2 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received event network-vif-plugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3aca911f-cba6-4e67-a26d-22b59306fe25 req-a57f220b-c204-4470-9f9d-252fd16a13b2 service nova] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3aca911f-cba6-4e67-a26d-22b59306fe25 req-a57f220b-c204-4470-9f9d-252fd16a13b2 service nova] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3aca911f-cba6-4e67-a26d-22b59306fe25 req-a57f220b-c204-4470-9f9d-252fd16a13b2 service nova] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG nova.compute.manager [req-3aca911f-cba6-4e67-a26d-22b59306fe25 req-a57f220b-c204-4470-9f9d-252fd16a13b2 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] No waiting events found dispatching network-vif-plugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:48:48 user nova-compute[76815]: WARNING nova.compute.manager [req-3aca911f-cba6-4e67-a26d-22b59306fe25 req-a57f220b-c204-4470-9f9d-252fd16a13b2 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received unexpected event network-vif-plugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db for instance with vm_state building and task_state spawning.
Nov 14 22:48:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-70344a78-2eab-42f2-b553-0295d67389fb req-11df8138-1528-48a6-ac7f-fca9e840a8aa service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updated VIF entry in instance network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG nova.network.neutron [req-70344a78-2eab-42f2-b553-0295d67389fb req-11df8138-1528-48a6-ac7f-fca9e840a8aa service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:48:48 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-70344a78-2eab-42f2-b553-0295d67389fb req-11df8138-1528-48a6-ac7f-fca9e840a8aa service nova] Releasing lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:48:49 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:48:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:48:49 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Instance spawned successfully.
Nov 14 22:48:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:48:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:48:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:48:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:48:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:48:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:48:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:48:50 user nova-compute[76815]: INFO nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 14 22:48:50 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:48:50 user nova-compute[76815]: INFO nova.compute.manager [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Took 5.82 seconds to build instance.
Nov 14 22:48:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f104234a-11e1-4b05-903b-83a527005ffc tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.914s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-98914242-b668-4855-956e-7eef16bbb4ed req-95ca194d-3c22-4b79-9070-edd64c4ab492 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received event network-vif-plugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-98914242-b668-4855-956e-7eef16bbb4ed req-95ca194d-3c22-4b79-9070-edd64c4ab492 service nova] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-98914242-b668-4855-956e-7eef16bbb4ed req-95ca194d-3c22-4b79-9070-edd64c4ab492 service nova] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-98914242-b668-4855-956e-7eef16bbb4ed req-95ca194d-3c22-4b79-9070-edd64c4ab492 service nova] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-98914242-b668-4855-956e-7eef16bbb4ed req-95ca194d-3c22-4b79-9070-edd64c4ab492 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] No waiting events found dispatching network-vif-plugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:48:50 user nova-compute[76815]: WARNING nova.compute.manager [req-98914242-b668-4855-956e-7eef16bbb4ed req-95ca194d-3c22-4b79-9070-edd64c4ab492 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received unexpected event network-vif-plugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db for instance with vm_state active and task_state None.
Nov 14 22:48:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-3fec333e-3823-4aaa-9ddc-4d3aa4bdfd39 req-4709b86e-88c8-448c-bfb7-cbff4a7fe96b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-3fec333e-3823-4aaa-9ddc-4d3aa4bdfd39 req-4709b86e-88c8-448c-bfb7-cbff4a7fe96b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing instance network info cache due to event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3fec333e-3823-4aaa-9ddc-4d3aa4bdfd39 req-4709b86e-88c8-448c-bfb7-cbff4a7fe96b service nova] Acquiring lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3fec333e-3823-4aaa-9ddc-4d3aa4bdfd39 req-4709b86e-88c8-448c-bfb7-cbff4a7fe96b service nova] Acquired lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG nova.network.neutron [req-3fec333e-3823-4aaa-9ddc-4d3aa4bdfd39 req-4709b86e-88c8-448c-bfb7-cbff4a7fe96b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG nova.network.neutron [req-3fec333e-3823-4aaa-9ddc-4d3aa4bdfd39 req-4709b86e-88c8-448c-bfb7-cbff4a7fe96b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updated VIF entry in instance network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG nova.network.neutron [req-3fec333e-3823-4aaa-9ddc-4d3aa4bdfd39 req-4709b86e-88c8-448c-bfb7-cbff4a7fe96b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:48:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3fec333e-3823-4aaa-9ddc-4d3aa4bdfd39 req-4709b86e-88c8-448c-bfb7-cbff4a7fe96b service nova] Releasing lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:48:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:52 user nova-compute[76815]: INFO nova.compute.manager [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Rebooting instance
Nov 14 22:48:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:48:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquired lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:48:52 user nova-compute[76815]: DEBUG nova.network.neutron [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:48:52 user nova-compute[76815]: DEBUG nova.network.neutron [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:48:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Releasing lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:48:52 user nova-compute[76815]: DEBUG nova.compute.manager [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:48:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-e4777c18-f2f3-4de9-8146-33771e5116b4 req-6667bc94-920f-4dd8-87fb-f856c977faaf service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-unplugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e4777c18-f2f3-4de9-8146-33771e5116b4 req-6667bc94-920f-4dd8-87fb-f856c977faaf service nova] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e4777c18-f2f3-4de9-8146-33771e5116b4 req-6667bc94-920f-4dd8-87fb-f856c977faaf service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e4777c18-f2f3-4de9-8146-33771e5116b4 req-6667bc94-920f-4dd8-87fb-f856c977faaf service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG nova.compute.manager [req-e4777c18-f2f3-4de9-8146-33771e5116b4 req-6667bc94-920f-4dd8-87fb-f856c977faaf service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] No waiting events found dispatching network-vif-unplugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:48:53 user nova-compute[76815]: WARNING nova.compute.manager [req-e4777c18-f2f3-4de9-8146-33771e5116b4 req-6667bc94-920f-4dd8-87fb-f856c977faaf service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received unexpected event network-vif-unplugged-e46efeef-6f27-406b-89df-2b488d6f8626 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Instance destroyed successfully.
Nov 14 22:48:53 user nova-compute[76815]: DEBUG nova.objects.instance [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'resources' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-195768833',display_name='tempest-TestMinimumBasicScenario-server-195768833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-195768833',id=50,image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLmhTJIJLVi3HmyN1E0yCRmhtxQ5+3uyg6nDP16MxilwWlIFe850K/hLeDBpU2lpCEcPQk6CaTTe3m/ZjCM2PNLLlG0F7TWuudKfnuWMKbU5utOdalqEngCERkL3wb2Ww==',key_name='tempest-TestMinimumBasicScenario-1998403551',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:46:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='769ed1e318574e63a3153f1661b887f2',ramdisk_id='',reservation_id='r-o85sjwda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546482846',owner_user_name='tempest-TestMinimumBasicScenario-546482846-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:48:53Z,user_data=None,user_id='b8f9992958464143ac94c697f6d23920',uuid=44f05803-a6e1-4ceb-bbc5-97e343c2bc25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converting VIF {"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_vif [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape46efeef-6f, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a151a2dc-a2d3-41f4-88d7-6bf3168344ad) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:48:53 user nova-compute[76815]: INFO os_vif [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f')
Nov 14 22:48:53 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUIoHjFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:48:53 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d43f632-6b5a-41b7-be10-8c8df93423ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:48:53 user nova-compute[76815]: No targets found.
Nov 14 22:48:53 user nova-compute[76815]: iSNS:
Nov 14 22:48:53 user nova-compute[76815]: No targets found.
Nov 14 22:48:53 user nova-compute[76815]: STATIC:
Nov 14 22:48:53 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af
Nov 14 22:48:53 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:48:53 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:48:53 user nova-compute[76815]: FIRMWARE:
Nov 14 22:48:53 user nova-compute[76815]: No targets found.
Nov 14 22:48:53 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:48:53 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:48:53 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc431a-559c-46aa-9b07-e0b88ddbdb20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e865f9-d694-4de1-954e-7aba1b9b9a46]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:48:53 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:48:53 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a477f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84e7ea1-8a52-4fe0-a06a-d4ee028f2a9f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec54b4d-0a32-4a4d-bbf2-9131dcc997b4]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c35d1a-ba4c-4efe-a1fa-62b010d8a1cf]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeb666c-17b1-4715-9686-7ecf8021b310]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:48:53 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2574d4bd-40f7-4721-9dc0-f7d0cb3b0679]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f947db1-ca6b-425d-b2cf-611341a55597]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260]
Nov 14 22:48:54 user nova-compute[76815]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260] successful.
Nov 14 22:48:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd12a1ff-9aaa-4bc0-ade9-22c533fae288]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] <== disconnect_volume: return (275ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Start _get_guest_xml network_info=[{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2d99853e-ce24-4fe1-8395-d1e6463fd33d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '2d99853e-ce24-4fe1-8395-d1e6463fd33d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUIoHjFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '44f05803-a6e1-4ceb-bbc5-97e343c2bc25', 'attached_at': '', 'detached_at': '', 'volume_id': '81b756a6-2f29-48a4-865a-dfa7742fa8af', 'serial': '81b756a6-2f29-48a4-865a-dfa7742fa8af'}, 'attachment_id': '93ac97ff-9c7e-427e-8675-101c4bd12f82', 'guest_format': None, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:48:54 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:48:54 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2d99853e-ce24-4fe1-8395-d1e6463fd33d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.objects.instance [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'vcpu_model' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.objects.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Object Instance<44f05803-a6e1-4ceb-bbc5-97e343c2bc25> lazy-loaded attributes: resources,vcpu_model {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUIoHjFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:48:54 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:48:54 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:48:54 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fb5575-667d-4927-952e-5ad7cb113992]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:48:54 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f629fa8-a982-4d29-b071-4923eeee0905]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af] added
Nov 14 22:48:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42fd74c-bdb4-46c5-9130-53affc25e6d2]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d76b4b-34e8-482d-9416-adf2d95295c1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUIoHjFS {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUIoHjFS" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7898b18a-cd50-4f23-adc8-000bc98de231]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RUIoHjFS'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b08007e-5bff-4524-8c10-6cf36c426991]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c9e0e-85af-4ceb-b10c-1e76606e39a3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:48:54 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:48:54 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:48:54 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:48:54 user nova-compute[76815]: 
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe8bfed-c4e1-4a80-b415-09ecedc823a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260]
Nov 14 22:48:54 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260] successful.
Nov 14 22:48:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1c39cb-df73-46d0-922e-440c6ea8f0f5]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2301c0db-1e29-41f9-972c-8e171a4f305a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:48:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:48:54 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acb12fb-2d2e-49dc-813d-35d7b97f6325]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:48:54 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUIoHjFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-be1632e2-fffd-4a9f-b7f2-76bbc24982ad req-9a3fa888-a112-49c9-91a3-374723dcda46 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-be1632e2-fffd-4a9f-b7f2-76bbc24982ad req-9a3fa888-a112-49c9-91a3-374723dcda46 service nova] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-be1632e2-fffd-4a9f-b7f2-76bbc24982ad req-9a3fa888-a112-49c9-91a3-374723dcda46 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-be1632e2-fffd-4a9f-b7f2-76bbc24982ad req-9a3fa888-a112-49c9-91a3-374723dcda46 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-be1632e2-fffd-4a9f-b7f2-76bbc24982ad req-9a3fa888-a112-49c9-91a3-374723dcda46 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] No waiting events found dispatching network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:48:55 user nova-compute[76815]: WARNING nova.compute.manager [req-be1632e2-fffd-4a9f-b7f2-76bbc24982ad req-9a3fa888-a112-49c9-91a3-374723dcda46 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received unexpected event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 22:48:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23138323632353362', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138323632353362', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-195768833',display_name='tempest-TestMinimumBasicScenario-server-195768833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-195768833',id=50,image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLmhTJIJLVi3HmyN1E0yCRmhtxQ5+3uyg6nDP16MxilwWlIFe850K/hLeDBpU2lpCEcPQk6CaTTe3m/ZjCM2PNLLlG0F7TWuudKfnuWMKbU5utOdalqEngCERkL3wb2Ww==',key_name='tempest-TestMinimumBasicScenario-1998403551',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:46:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='769ed1e318574e63a3153f1661b887f2',ramdisk_id='',reservation_id='r-o85sjwda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546482846',owner_user_name='tempest-TestMinimumBasicScenario-546482846-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:48:53Z,user_data=None,user_id='b8f9992958464143ac94c697f6d23920',uuid=44f05803-a6e1-4ceb-bbc5-97e343c2bc25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converting VIF {"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'pci_devices' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.objects.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Object Instance<44f05803-a6e1-4ceb-bbc5-97e343c2bc25> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:48:55 user nova-compute[76815]:   <uuid>44f05803-a6e1-4ceb-bbc5-97e343c2bc25</uuid>
Nov 14 22:48:55 user nova-compute[76815]:   <name>instance-00000032</name>
Nov 14 22:48:55 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:48:55 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:48:55 user nova-compute[76815]:   <metadata>
Nov 14 22:48:55 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:48:55 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:48:55 user nova-compute[76815]:       <nova:name>tempest-TestMinimumBasicScenario-server-195768833</nova:name>
Nov 14 22:48:55 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:48:54</nova:creationTime>
Nov 14 22:48:55 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:48:55 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:48:55 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:48:55 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:48:55 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:48:55 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:48:55 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:48:55 user nova-compute[76815]:       <nova:owner>
Nov 14 22:48:55 user nova-compute[76815]:         <nova:user uuid="b8f9992958464143ac94c697f6d23920">tempest-TestMinimumBasicScenario-546482846-project-member</nova:user>
Nov 14 22:48:55 user nova-compute[76815]:         <nova:project uuid="769ed1e318574e63a3153f1661b887f2">tempest-TestMinimumBasicScenario-546482846</nova:project>
Nov 14 22:48:55 user nova-compute[76815]:       </nova:owner>
Nov 14 22:48:55 user nova-compute[76815]:       <nova:root type="image" uuid="2d99853e-ce24-4fe1-8395-d1e6463fd33d"/>
Nov 14 22:48:55 user nova-compute[76815]:       <nova:ports>
Nov 14 22:48:55 user nova-compute[76815]:         <nova:port uuid="e46efeef-6f27-406b-89df-2b488d6f8626">
Nov 14 22:48:55 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 22:48:55 user nova-compute[76815]:         </nova:port>
Nov 14 22:48:55 user nova-compute[76815]:       </nova:ports>
Nov 14 22:48:55 user nova-compute[76815]:     </nova:instance>
Nov 14 22:48:55 user nova-compute[76815]:   </metadata>
Nov 14 22:48:55 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:48:55 user nova-compute[76815]:     <system>
Nov 14 22:48:55 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:48:55 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:48:55 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:48:55 user nova-compute[76815]:       <entry name="serial">44f05803-a6e1-4ceb-bbc5-97e343c2bc25</entry>
Nov 14 22:48:55 user nova-compute[76815]:       <entry name="uuid">44f05803-a6e1-4ceb-bbc5-97e343c2bc25</entry>
Nov 14 22:48:55 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:48:55 user nova-compute[76815]:     </system>
Nov 14 22:48:55 user nova-compute[76815]:   </sysinfo>
Nov 14 22:48:55 user nova-compute[76815]:   <os>
Nov 14 22:48:55 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:48:55 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:48:55 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:48:55 user nova-compute[76815]:   </os>
Nov 14 22:48:55 user nova-compute[76815]:   <features>
Nov 14 22:48:55 user nova-compute[76815]:     <acpi/>
Nov 14 22:48:55 user nova-compute[76815]:     <apic/>
Nov 14 22:48:55 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:48:55 user nova-compute[76815]:   </features>
Nov 14 22:48:55 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:48:55 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:48:55 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:48:55 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:48:55 user nova-compute[76815]:   </clock>
Nov 14 22:48:55 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:48:55 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:48:55 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:48:55 user nova-compute[76815]:   </cpu>
Nov 14 22:48:55 user nova-compute[76815]:   <devices>
Nov 14 22:48:55 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:48:55 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:48:55 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk"/>
Nov 14 22:48:55 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:48:55 user nova-compute[76815]:     </disk>
Nov 14 22:48:55 user nova-compute[76815]:     <disk type="block" device="disk">
Nov 14 22:48:55 user nova-compute[76815]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:48:55 user nova-compute[76815]:       <source dev="/dev/sdb"/>
Nov 14 22:48:55 user nova-compute[76815]:       <target dev="vdb" bus="virtio"/>
Nov 14 22:48:55 user nova-compute[76815]:       <serial>81b756a6-2f29-48a4-865a-dfa7742fa8af</serial>
Nov 14 22:48:55 user nova-compute[76815]:     </disk>
Nov 14 22:48:55 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:48:55 user nova-compute[76815]:       <mac address="fa:16:3e:21:cd:75"/>
Nov 14 22:48:55 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:48:55 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:48:55 user nova-compute[76815]:       <target dev="tape46efeef-6f"/>
Nov 14 22:48:55 user nova-compute[76815]:     </interface>
Nov 14 22:48:55 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:48:55 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/console.log" append="off"/>
Nov 14 22:48:55 user nova-compute[76815]:     </serial>
Nov 14 22:48:55 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:48:55 user nova-compute[76815]:     <video>
Nov 14 22:48:55 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:48:55 user nova-compute[76815]:     </video>
Nov 14 22:48:55 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:48:55 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:48:55 user nova-compute[76815]:     </rng>
Nov 14 22:48:55 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:48:55 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:48:55 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:48:55 user nova-compute[76815]:     </memballoon>
Nov 14 22:48:55 user nova-compute[76815]:   </devices>
Nov 14 22:48:55 user nova-compute[76815]: </domain>
Nov 14 22:48:55 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'trusted_certs' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG nova.objects.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Object Instance<44f05803-a6e1-4ceb-bbc5-97e343c2bc25> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:48:55 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f264af710e9016e585f6d0757a33443d4ff3450 --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Cannot resize image /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG nova.objects.instance [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'migration_context' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG nova.objects.base [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Object Instance<44f05803-a6e1-4ceb-bbc5-97e343c2bc25> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=76815) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-195768833',display_name='tempest-TestMinimumBasicScenario-server-195768833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-195768833',id=50,image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLmhTJIJLVi3HmyN1E0yCRmhtxQ5+3uyg6nDP16MxilwWlIFe850K/hLeDBpU2lpCEcPQk6CaTTe3m/ZjCM2PNLLlG0F7TWuudKfnuWMKbU5utOdalqEngCERkL3wb2Ww==',key_name='tempest-TestMinimumBasicScenario-1998403551',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:46:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='769ed1e318574e63a3153f1661b887f2',ramdisk_id='',reservation_id='r-o85sjwda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546482846',owner_user_name='tempest-TestMinimumBasicScenario-546482846-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:48:53Z,user_data=None,user_id='b8f9992958464143ac94c697f6d23920',uuid=44f05803-a6e1-4ceb-bbc5-97e343c2bc25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converting VIF {"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG os_vif [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '301535b2-3368-502d-9084-4c69c3fa82e4', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape46efeef-6f, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape46efeef-6f, col_values=(('qos', UUID('81dd6040-0a03-40c6-a615-93ff37f38b24')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape46efeef-6f, col_values=(('external_ids', {'iface-id': 'e46efeef-6f27-406b-89df-2b488d6f8626', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:cd:75', 'vm-uuid': '44f05803-a6e1-4ceb-bbc5-97e343c2bc25'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:48:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:56 user nova-compute[76815]: INFO os_vif [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f')
Nov 14 22:48:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-72ed116c-3f15-48a9-90f6-126e827ee737 req-1a376c3a-cc87-4a84-95ae-ff2a5070f277 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:48:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72ed116c-3f15-48a9-90f6-126e827ee737 req-1a376c3a-cc87-4a84-95ae-ff2a5070f277 service nova] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72ed116c-3f15-48a9-90f6-126e827ee737 req-1a376c3a-cc87-4a84-95ae-ff2a5070f277 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:58 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-72ed116c-3f15-48a9-90f6-126e827ee737 req-1a376c3a-cc87-4a84-95ae-ff2a5070f277 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:58 user nova-compute[76815]: DEBUG nova.compute.manager [req-72ed116c-3f15-48a9-90f6-126e827ee737 req-1a376c3a-cc87-4a84-95ae-ff2a5070f277 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] No waiting events found dispatching network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:48:58 user nova-compute[76815]: WARNING nova.compute.manager [req-72ed116c-3f15-48a9-90f6-126e827ee737 req-1a376c3a-cc87-4a84-95ae-ff2a5070f277 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received unexpected event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 22:48:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:48:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:48:59 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Instance rebooted successfully.
Nov 14 22:48:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:48:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:48:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:48:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:48:59 user nova-compute[76815]: INFO nova.compute.manager [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Terminating instance
Nov 14 22:48:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:48:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-71d60a82-1de4-4d49-9f88-d260444f620d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.610s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-25606501-12b9-4eab-a910-84aadc916844 req-b3898f27-6ac0-4a25-aac9-0047f3ce4e2b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-25606501-12b9-4eab-a910-84aadc916844 req-b3898f27-6ac0-4a25-aac9-0047f3ce4e2b service nova] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-25606501-12b9-4eab-a910-84aadc916844 req-b3898f27-6ac0-4a25-aac9-0047f3ce4e2b service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-25606501-12b9-4eab-a910-84aadc916844 req-b3898f27-6ac0-4a25-aac9-0047f3ce4e2b service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-25606501-12b9-4eab-a910-84aadc916844 req-b3898f27-6ac0-4a25-aac9-0047f3ce4e2b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] No waiting events found dispatching network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:49:00 user nova-compute[76815]: WARNING nova.compute.manager [req-25606501-12b9-4eab-a910-84aadc916844 req-b3898f27-6ac0-4a25-aac9-0047f3ce4e2b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received unexpected event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 for instance with vm_state active and task_state None.
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-104d8888-2f1d-4842-a360-6c6d8b75161e req-5d6c5677-cf6c-4507-8812-211e808ae31f service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-unplugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-104d8888-2f1d-4842-a360-6c6d8b75161e req-5d6c5677-cf6c-4507-8812-211e808ae31f service nova] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-104d8888-2f1d-4842-a360-6c6d8b75161e req-5d6c5677-cf6c-4507-8812-211e808ae31f service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-104d8888-2f1d-4842-a360-6c6d8b75161e req-5d6c5677-cf6c-4507-8812-211e808ae31f service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-104d8888-2f1d-4842-a360-6c6d8b75161e req-5d6c5677-cf6c-4507-8812-211e808ae31f service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] No waiting events found dispatching network-vif-unplugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.compute.manager [req-104d8888-2f1d-4842-a360-6c6d8b75161e req-5d6c5677-cf6c-4507-8812-211e808ae31f service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-unplugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:00 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Instance destroyed successfully.
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.objects.instance [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'resources' on Instance uuid 038b8a86-c1ae-43c6-b5ac-d560babe8258 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1987836517',display_name='tempest-ServerRescueNegativeTestJSON-server-1987836517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1987836517',id=44,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-j8ql9gl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:34:59Z,user_data=None,user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=038b8a86-c1ae-43c6-b5ac-d560babe8258,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "address": "fa:16:3e:a7:55:f9", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0471f42b-66", "ovs_interfaceid": "0471f42b-66c8-48c7-ba0a-f79ef88db9d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:55:f9,bridge_name='br-int',has_traffic_filtering=True,id=0471f42b-66c8-48c7-ba0a-f79ef88db9d5,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0471f42b-66') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG os_vif [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:55:f9,bridge_name='br-int',has_traffic_filtering=True,id=0471f42b-66c8-48c7-ba0a-f79ef88db9d5,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0471f42b-66') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0471f42b-66, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d147690d-1340-4501-be81-ba8599911d6d) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:49:00 user nova-compute[76815]: INFO os_vif [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:55:f9,bridge_name='br-int',has_traffic_filtering=True,id=0471f42b-66c8-48c7-ba0a-f79ef88db9d5,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0471f42b-66')
Nov 14 22:49:00 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Deleting instance files /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258_del
Nov 14 22:49:00 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Deletion of /opt/stack/data/nova/instances/038b8a86-c1ae-43c6-b5ac-d560babe8258_del complete
Nov 14 22:49:00 user nova-compute[76815]: INFO nova.compute.manager [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 22:49:00 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:49:00 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:49:01 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:49:01 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Took 0.46 seconds to deallocate network for instance.
Nov 14 22:49:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:01 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:49:01 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:49:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:01 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Deleted allocations for instance 038b8a86-c1ae-43c6-b5ac-d560babe8258
Nov 14 22:49:01 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-ea8a0e76-37f3-4aba-98d7-cc388e68d845 tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.853s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-530a5404-d9ee-48b6-8a0d-8af35f6b746d req-7a818dcc-a242-4f45-8fdf-d0ea53e4ecf4 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:49:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-530a5404-d9ee-48b6-8a0d-8af35f6b746d req-7a818dcc-a242-4f45-8fdf-d0ea53e4ecf4 service nova] Acquiring lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-530a5404-d9ee-48b6-8a0d-8af35f6b746d req-7a818dcc-a242-4f45-8fdf-d0ea53e4ecf4 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:02 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-530a5404-d9ee-48b6-8a0d-8af35f6b746d req-7a818dcc-a242-4f45-8fdf-d0ea53e4ecf4 service nova] Lock "038b8a86-c1ae-43c6-b5ac-d560babe8258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-530a5404-d9ee-48b6-8a0d-8af35f6b746d req-7a818dcc-a242-4f45-8fdf-d0ea53e4ecf4 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] No waiting events found dispatching network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:49:02 user nova-compute[76815]: WARNING nova.compute.manager [req-530a5404-d9ee-48b6-8a0d-8af35f6b746d req-7a818dcc-a242-4f45-8fdf-d0ea53e4ecf4 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received unexpected event network-vif-plugged-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 for instance with vm_state deleted and task_state None.
Nov 14 22:49:02 user nova-compute[76815]: DEBUG nova.compute.manager [req-530a5404-d9ee-48b6-8a0d-8af35f6b746d req-7a818dcc-a242-4f45-8fdf-d0ea53e4ecf4 service nova] [instance: 038b8a86-c1ae-43c6-b5ac-d560babe8258] Received event network-vif-deleted-0471f42b-66c8-48c7-ba0a-f79ef88db9d5 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:49:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [{"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-92a51373-b728-4a91-a503-a87740e84895" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:49:03 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:49:04 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:49:05 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:49:05 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:49:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=24.915637969970703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 92a51373-b728-4a91-a503-a87740e84895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:49:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:06 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:49:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:08 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:09 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:25 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:49:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:49:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:49:28 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:49:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:49:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "92a51373-b728-4a91-a503-a87740e84895" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:50 user nova-compute[76815]: INFO nova.compute.manager [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Terminating instance
Nov 14 22:49:50 user nova-compute[76815]: DEBUG nova.compute.manager [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-a162be46-af97-4cfe-8938-97dd01026c9d req-a9ebf95c-b4a9-4ae4-b69f-0ca6d41e59e4 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-unplugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a162be46-af97-4cfe-8938-97dd01026c9d req-a9ebf95c-b4a9-4ae4-b69f-0ca6d41e59e4 service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a162be46-af97-4cfe-8938-97dd01026c9d req-a9ebf95c-b4a9-4ae4-b69f-0ca6d41e59e4 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a162be46-af97-4cfe-8938-97dd01026c9d req-a9ebf95c-b4a9-4ae4-b69f-0ca6d41e59e4 service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-a162be46-af97-4cfe-8938-97dd01026c9d req-a9ebf95c-b4a9-4ae4-b69f-0ca6d41e59e4 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-unplugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG nova.compute.manager [req-a162be46-af97-4cfe-8938-97dd01026c9d req-a9ebf95c-b4a9-4ae4-b69f-0ca6d41e59e4 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-unplugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:49:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 92a51373-b728-4a91-a503-a87740e84895] Instance destroyed successfully.
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lazy-loading 'resources' on Instance uuid 92a51373-b728-4a91-a503-a87740e84895 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1645363141',display_name='tempest-ServerRescueNegativeTestJSON-server-1645363141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1645363141',id=43,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:37:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b06ff4e376e9419babeacd8a4d586574',ramdisk_id='',reservation_id='r-fcbmz118',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1323022133',owner_user_name='tempest-ServerRescueNegativeTestJSON-1323022133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:39:42Z,user_data=None,user_id='d7726302e74c45ba94acea58ff3ca7c6',uuid=92a51373-b728-4a91-a503-a87740e84895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converting VIF {"id": "cc87e561-54f9-4667-9c88-0e0844042c51", "address": "fa:16:3e:ca:4f:31", "network": {"id": "d7908e9b-0aad-4f8e-9983-21ce80a6b06a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2097891404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b06ff4e376e9419babeacd8a4d586574", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc87e561-54", "ovs_interfaceid": "cc87e561-54f9-4667-9c88-0e0844042c51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=cc87e561-54f9-4667-9c88-0e0844042c51,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc87e561-54') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG os_vif [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=cc87e561-54f9-4667-9c88-0e0844042c51,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc87e561-54') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc87e561-54, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a421d29d-26d2-4e52-9264-e7c83c98c5ee) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:49:51 user nova-compute[76815]: INFO os_vif [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:4f:31,bridge_name='br-int',has_traffic_filtering=True,id=cc87e561-54f9-4667-9c88-0e0844042c51,network=Network(d7908e9b-0aad-4f8e-9983-21ce80a6b06a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc87e561-54')
Nov 14 22:49:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Deleting instance files /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895_del
Nov 14 22:49:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Deletion of /opt/stack/data/nova/instances/92a51373-b728-4a91-a503-a87740e84895_del complete
Nov 14 22:49:51 user nova-compute[76815]: INFO nova.compute.manager [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] [instance: 92a51373-b728-4a91-a503-a87740e84895] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 22:49:51 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 92a51373-b728-4a91-a503-a87740e84895] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 92a51373-b728-4a91-a503-a87740e84895] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:49:51 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 92a51373-b728-4a91-a503-a87740e84895] Took 0.40 seconds to deallocate network for instance.
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-65c69f51-b553-49d2-8593-c95de746ecc0 req-5a8b6453-c157-4671-81d8-f26efa3e4908 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-deleted-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:49:51 user nova-compute[76815]: INFO nova.compute.manager [req-65c69f51-b553-49d2-8593-c95de746ecc0 req-5a8b6453-c157-4671-81d8-f26efa3e4908 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Neutron deleted interface cc87e561-54f9-4667-9c88-0e0844042c51; detaching it from the instance and deleting it from the info cache
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.network.neutron [req-65c69f51-b553-49d2-8593-c95de746ecc0 req-5a8b6453-c157-4671-81d8-f26efa3e4908 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.compute.manager [req-65c69f51-b553-49d2-8593-c95de746ecc0 req-5a8b6453-c157-4671-81d8-f26efa3e4908 service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Detach interface failed, port_id=cc87e561-54f9-4667-9c88-0e0844042c51, reason: Instance 92a51373-b728-4a91-a503-a87740e84895 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:51 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:49:52 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:49:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:52 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Deleted allocations for instance 92a51373-b728-4a91-a503-a87740e84895
Nov 14 22:49:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-0f3cd59f-5b97-4f78-bfd1-c6563752c94c tempest-ServerRescueNegativeTestJSON-1323022133 tempest-ServerRescueNegativeTestJSON-1323022133-project-member] Lock "92a51373-b728-4a91-a503-a87740e84895" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.606s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-7f306a2f-c909-4dd7-a284-54620bc85759 req-4222e180-4476-4bcc-b55b-3b61ee74751d service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:49:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7f306a2f-c909-4dd7-a284-54620bc85759 req-4222e180-4476-4bcc-b55b-3b61ee74751d service nova] Acquiring lock "92a51373-b728-4a91-a503-a87740e84895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:49:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7f306a2f-c909-4dd7-a284-54620bc85759 req-4222e180-4476-4bcc-b55b-3b61ee74751d service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:49:52 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7f306a2f-c909-4dd7-a284-54620bc85759 req-4222e180-4476-4bcc-b55b-3b61ee74751d service nova] Lock "92a51373-b728-4a91-a503-a87740e84895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:49:52 user nova-compute[76815]: DEBUG nova.compute.manager [req-7f306a2f-c909-4dd7-a284-54620bc85759 req-4222e180-4476-4bcc-b55b-3b61ee74751d service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] No waiting events found dispatching network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:49:52 user nova-compute[76815]: WARNING nova.compute.manager [req-7f306a2f-c909-4dd7-a284-54620bc85759 req-4222e180-4476-4bcc-b55b-3b61ee74751d service nova] [instance: 92a51373-b728-4a91-a503-a87740e84895] Received unexpected event network-vif-plugged-cc87e561-54f9-4667-9c88-0e0844042c51 for instance with vm_state deleted and task_state None.
Nov 14 22:49:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:50:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:50:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:50:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:50:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:50:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:50:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:50:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:50:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:50:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:50:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:50:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:07 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:50:07 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=24.941173553466797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:50:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:50:08 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:08 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:08 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:50:11 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:50:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:50:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:50:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:50:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:50:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:50:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-d228895d-2958-46bc-ba03-b5c299e79c9b req-a5484b9c-c59b-420a-b3ae-4e830e1d4803 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received event network-changed-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:50:35 user nova-compute[76815]: DEBUG nova.compute.manager [req-d228895d-2958-46bc-ba03-b5c299e79c9b req-a5484b9c-c59b-420a-b3ae-4e830e1d4803 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Refreshing instance network info cache due to event network-changed-4a8c65d8-764c-4e40-aefe-3dca6f7c97db. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:50:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d228895d-2958-46bc-ba03-b5c299e79c9b req-a5484b9c-c59b-420a-b3ae-4e830e1d4803 service nova] Acquiring lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:50:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d228895d-2958-46bc-ba03-b5c299e79c9b req-a5484b9c-c59b-420a-b3ae-4e830e1d4803 service nova] Acquired lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:50:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-d228895d-2958-46bc-ba03-b5c299e79c9b req-a5484b9c-c59b-420a-b3ae-4e830e1d4803 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Refreshing network info cache for port 4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:50:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-d228895d-2958-46bc-ba03-b5c299e79c9b req-a5484b9c-c59b-420a-b3ae-4e830e1d4803 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updated VIF entry in instance network info cache for port 4a8c65d8-764c-4e40-aefe-3dca6f7c97db. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:50:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-d228895d-2958-46bc-ba03-b5c299e79c9b req-a5484b9c-c59b-420a-b3ae-4e830e1d4803 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating instance_info_cache with network_info: [{"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:50:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d228895d-2958-46bc-ba03-b5c299e79c9b req-a5484b9c-c59b-420a-b3ae-4e830e1d4803 service nova] Releasing lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:50:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:50:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:50:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:50:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:50:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG nova.objects.instance [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:50:37 user nova-compute[76815]: INFO nova.compute.manager [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attaching volume 1b55a4bc-b9a1-43d3-b4eb-c39734d54aea to /dev/vdb
Nov 14 22:50:37 user nova-compute[76815]: DEBUG os_brick.utils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c78a0e5-1b9f-4f7c-8796-6ade12388efb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4ea9a5-d779-4295-8dbe-809c6789a6d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1588dc4-eb03-4f23-a027-328e88341f07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b113a3-4922-4fe8-b030-fc75398b8195]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:37 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:50:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:38 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:50:38 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:50:38 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a168b7-9b4e-49c9-84a4-d8acd4aab74a]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:38 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:50:38 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:50:38 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:50:38 user nova-compute[76815]: DEBUG os_brick.utils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:50:38 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating existing volume attachment record: 75c62399-a018-4fdd-9896-7cd586be1f7a {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:50:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxlBKQyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:50:42 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:50:42 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:50:42 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebd522c-464c-4a0a-85b7-5eec82b549a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:50:42 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4fc0b4-55c1-4449-a423-fce282f79d2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea] added
Nov 14 22:50:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf42076b-71f8-4230-b42b-2011d6056338]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b9d50b-7c4a-4413-ad33-fd21cfa60f22]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxlBKQyw {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxlBKQyw" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[408a64d4-2f0d-44b4-bb20-2cc53e9a3575]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxlBKQyw'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[439fe783-74fe-44e1-93d3-3bf4fca2faf9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d3f82c-a8aa-4575-9a87-54cd194f2239]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:50:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:50:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1366e3-e79a-4d26-89f5-8d6f7ea7edbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea, portal: 172.16.0.220,3260]
Nov 14 22:50:42 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea, portal: 172.16.0.220,3260] successful.
Nov 14 22:50:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[864f20a2-52a1-4ec4-a8a3-69fd613f4869]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd71a044-ca6b-4456-862b-7c60e7e204a5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:50:42 user nova-compute[76815]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea (non-flash)
Nov 14 22:50:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:50:42 user nova-compute[76815]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea (non-flash)
Nov 14 22:50:42 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8634d8-9ed4-4618-afeb-0a449cb885fb]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxlBKQyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:50:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:50:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23830626366343137', 'path': '/dev/sdc'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:50:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830626366343137', 'path': '/dev/sdc'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:50:43 user nova-compute[76815]: DEBUG nova.objects.instance [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:50:43 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:50:43 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:50:43 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:50:43 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:50:43 user nova-compute[76815]:   <serial>1b55a4bc-b9a1-43d3-b4eb-c39734d54aea</serial>
Nov 14 22:50:43 user nova-compute[76815]: </disk>
Nov 14 22:50:43 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:50:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:50:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:50:44 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No VIF found with MAC fa:16:3e:40:2f:bb, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:50:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-22c5311f-e727-4e05-849c-6eedc4fe2582 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.403s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:50:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ab9ba64-31e3-4666-9980-940fca7bfb90 req-3c09ad3c-9a3c-4694-876c-3f7f99c4bcf6 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:50:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-6ab9ba64-31e3-4666-9980-940fca7bfb90 req-3c09ad3c-9a3c-4694-876c-3f7f99c4bcf6 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing instance network info cache due to event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:50:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ab9ba64-31e3-4666-9980-940fca7bfb90 req-3c09ad3c-9a3c-4694-876c-3f7f99c4bcf6 service nova] Acquiring lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:50:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ab9ba64-31e3-4666-9980-940fca7bfb90 req-3c09ad3c-9a3c-4694-876c-3f7f99c4bcf6 service nova] Acquired lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:50:44 user nova-compute[76815]: DEBUG nova.network.neutron [req-6ab9ba64-31e3-4666-9980-940fca7bfb90 req-3c09ad3c-9a3c-4694-876c-3f7f99c4bcf6 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-6ab9ba64-31e3-4666-9980-940fca7bfb90 req-3c09ad3c-9a3c-4694-876c-3f7f99c4bcf6 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updated VIF entry in instance network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-6ab9ba64-31e3-4666-9980-940fca7bfb90 req-3c09ad3c-9a3c-4694-876c-3f7f99c4bcf6 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-6ab9ba64-31e3-4666-9980-940fca7bfb90 req-3c09ad3c-9a3c-4694-876c-3f7f99c4bcf6 service nova] Releasing lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-11dc42d3-690e-49b8-9153-8cc41481f399 req-e1f8905c-26f2-4687-a3b4-78d1ad4976a8 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.compute.manager [req-11dc42d3-690e-49b8-9153-8cc41481f399 req-e1f8905c-26f2-4687-a3b4-78d1ad4976a8 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing instance network info cache due to event network-changed-e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-11dc42d3-690e-49b8-9153-8cc41481f399 req-e1f8905c-26f2-4687-a3b4-78d1ad4976a8 service nova] Acquiring lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-11dc42d3-690e-49b8-9153-8cc41481f399 req-e1f8905c-26f2-4687-a3b4-78d1ad4976a8 service nova] Acquired lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-11dc42d3-690e-49b8-9153-8cc41481f399 req-e1f8905c-26f2-4687-a3b4-78d1ad4976a8 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Refreshing network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:50:45 user nova-compute[76815]: INFO nova.compute.manager [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Detaching volume 81b756a6-2f29-48a4-865a-dfa7742fa8af
Nov 14 22:50:45 user nova-compute[76815]: INFO nova.virt.block_device [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Attempting to driver detach volume 81b756a6-2f29-48a4-865a-dfa7742fa8af from mountpoint /dev/vdb
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Attempting to detach device vdb from instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:50:45 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:50:45 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:50:45 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:50:45 user nova-compute[76815]:   <serial>81b756a6-2f29-48a4-865a-dfa7742fa8af</serial>
Nov 14 22:50:45 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 22:50:45 user nova-compute[76815]: </disk>
Nov 14 22:50:45 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:50:45 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully detached device vdb from instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 from the persistent domain config.
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:50:45 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:50:45 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:50:45 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:50:45 user nova-compute[76815]:   <serial>81b756a6-2f29-48a4-865a-dfa7742fa8af</serial>
Nov 14 22:50:45 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 22:50:45 user nova-compute[76815]: </disk>
Nov 14 22:50:45 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-11dc42d3-690e-49b8-9153-8cc41481f399 req-e1f8905c-26f2-4687-a3b4-78d1ad4976a8 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updated VIF entry in instance network info cache for port e46efeef-6f27-406b-89df-2b488d6f8626. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG nova.network.neutron [req-11dc42d3-690e-49b8-9153-8cc41481f399 req-e1f8905c-26f2-4687-a3b4-78d1ad4976a8 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [{"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:50:45 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-11dc42d3-690e-49b8-9153-8cc41481f399 req-e1f8905c-26f2-4687-a3b4-78d1ad4976a8 service nova] Releasing lock "refresh_cache-44f05803-a6e1-4ceb-bbc5-97e343c2bc25" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:50:46 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:50:46 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:50:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:50:51 user nova-compute[76815]: INFO nova.compute.manager [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Detaching volume 1b55a4bc-b9a1-43d3-b4eb-c39734d54aea
Nov 14 22:50:51 user nova-compute[76815]: INFO nova.virt.block_device [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attempting to driver detach volume 1b55a4bc-b9a1-43d3-b4eb-c39734d54aea from mountpoint /dev/vdb
Nov 14 22:50:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Attempting to detach device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:50:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:50:51 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:50:51 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:50:51 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:50:51 user nova-compute[76815]:   <serial>1b55a4bc-b9a1-43d3-b4eb-c39734d54aea</serial>
Nov 14 22:50:51 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:50:51 user nova-compute[76815]: </disk>
Nov 14 22:50:51 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:50:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully detached device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the persistent domain config.
Nov 14 22:50:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:50:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:50:51 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:50:51 user nova-compute[76815]:   <source dev="/dev/sdc"/>
Nov 14 22:50:51 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:50:51 user nova-compute[76815]:   <serial>1b55a4bc-b9a1-43d3-b4eb-c39734d54aea</serial>
Nov 14 22:50:51 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:50:51 user nova-compute[76815]: </disk>
Nov 14 22:50:51 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:50:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:50:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:50:56 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:01 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:05 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:51:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:51:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:51:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:51:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:51:05 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating instance_info_cache with network_info: [{"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:51:05 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:51:05 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:51:06 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 is timed out.
Nov 14 22:51:06 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully detached device vdb from instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 from the live domain config.
Nov 14 22:51:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUIoHjFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:51:06 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0b7314-8814-4341-b066-393a67798079]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:51:06 user nova-compute[76815]: No targets found.
Nov 14 22:51:06 user nova-compute[76815]: iSNS:
Nov 14 22:51:06 user nova-compute[76815]: No targets found.
Nov 14 22:51:06 user nova-compute[76815]: STATIC:
Nov 14 22:51:06 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af
Nov 14 22:51:06 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:51:06 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:51:06 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea
Nov 14 22:51:06 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:51:06 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:51:06 user nova-compute[76815]: FIRMWARE:
Nov 14 22:51:06 user nova-compute[76815]: No targets found.
Nov 14 22:51:06 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:51:06 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:51:06 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b24495-e445-4078-a8e3-fa85f271643a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b810e25b-7b9c-4e86-92db-348790b822cd]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:51:06 user nova-compute[76815]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea (non-flash)
Nov 14 22:51:06 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af (non-flash)
Nov 14 22:51:06 user nova-compute[76815]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea (non-flash)
Nov 14 22:51:06 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a477f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[117e1439-37e2-4f61-91bf-c46d4c4a7d23]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdec72f-b5de-47ee-b854-2c991d38b274]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c1527-d6f2-41c9-91af-a5f3547ea0c3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b2afdb-aa00-4542-8a03-068d68243e60]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3725c1d-2a52-4316-bd61-1ef57e34730f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79f5885-3ac4-42a7-987f-7a8da5fd30c0]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260]
Nov 14 22:51:06 user nova-compute[76815]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af, portal: 172.16.0.220,3260] successful.
Nov 14 22:51:06 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81b756a6-2f29-48a4-865a-dfa7742fa8af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a6b2e4-aa78-4359-aa95-de1069dca189]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] <== disconnect_volume: return (329ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:51:06 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG nova.objects.instance [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'flavor' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-907a6450-2e4e-4fa9-b220-75718c377bf9 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:08 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:51:08 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:51:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=24.930355072021484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:51:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:51:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:51:10 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:11 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa is timed out.
Nov 14 22:51:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully detached device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the live domain config.
Nov 14 22:51:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxlBKQyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:51:11 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3031c4-3e1b-4d5a-9b7c-8ec49ce11ef6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:51:11 user nova-compute[76815]: No targets found.
Nov 14 22:51:11 user nova-compute[76815]: iSNS:
Nov 14 22:51:11 user nova-compute[76815]: No targets found.
Nov 14 22:51:11 user nova-compute[76815]: STATIC:
Nov 14 22:51:11 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea
Nov 14 22:51:11 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:51:11 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:51:11 user nova-compute[76815]: FIRMWARE:
Nov 14 22:51:11 user nova-compute[76815]: No targets found.
Nov 14 22:51:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:51:11 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:51:11 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80b99f4-1acc-43a0-b11d-2edbe467ebad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a7473e-c33e-48fb-acd6-b512f9942e74]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea (non-flash)
Nov 14 22:51:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea (non-flash)
Nov 14 22:51:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a430bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea'): ({'sdc'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Removing single pathed devices sdc {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e88a352-4c56-4451-9911-b68068f61ef0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecf87fd-f260-45b4-a4e1-289a28fe89ae]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Flushing IO for device /dev/sdc {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5822e1f2-45fa-4afc-b395-15090e732989]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc2f4ea-1054-4f94-a34c-718b171a936e]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] SCSI volumes sdc have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe6458c-e98f-4a29-bb38-384b32b92e68]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --logout" returned: 0 in 0.133s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcff55f-4cc2-4e47-bb76-97f643f99d9b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea, portal: 172.16.0.220,3260]
Nov 14 22:51:12 user nova-compute[76815]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea, portal: 172.16.0.220,3260] successful.
Nov 14 22:51:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b55a4bc-b9a1-43d3-b4eb-c39734d54aea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[321a8282-c246-412c-837b-2a74d2bf304e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== disconnect_volume: return (355ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG nova.objects.instance [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:51:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8583682e-7af4-43dd-bf8a-286b8109430f tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.718s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:51:16 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:51:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:51:21 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:51:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:51:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:51:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:51:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:51:26 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:38 user nova-compute[76815]: INFO nova.compute.manager [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Terminating instance
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-d767f73f-7068-4027-b390-09167d27d2e7 req-77800bc9-8bdc-4fef-a2fd-cd0a855bbb72 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-unplugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d767f73f-7068-4027-b390-09167d27d2e7 req-77800bc9-8bdc-4fef-a2fd-cd0a855bbb72 service nova] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d767f73f-7068-4027-b390-09167d27d2e7 req-77800bc9-8bdc-4fef-a2fd-cd0a855bbb72 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-d767f73f-7068-4027-b390-09167d27d2e7 req-77800bc9-8bdc-4fef-a2fd-cd0a855bbb72 service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-d767f73f-7068-4027-b390-09167d27d2e7 req-77800bc9-8bdc-4fef-a2fd-cd0a855bbb72 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] No waiting events found dispatching network-vif-unplugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-d767f73f-7068-4027-b390-09167d27d2e7 req-77800bc9-8bdc-4fef-a2fd-cd0a855bbb72 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-unplugged-e46efeef-6f27-406b-89df-2b488d6f8626 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:51:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Instance destroyed successfully.
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.objects.instance [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'resources' on Instance uuid 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-195768833',display_name='tempest-TestMinimumBasicScenario-server-195768833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-195768833',id=50,image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLmhTJIJLVi3HmyN1E0yCRmhtxQ5+3uyg6nDP16MxilwWlIFe850K/hLeDBpU2lpCEcPQk6CaTTe3m/ZjCM2PNLLlG0F7TWuudKfnuWMKbU5utOdalqEngCERkL3wb2Ww==',key_name='tempest-TestMinimumBasicScenario-1998403551',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:46:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='769ed1e318574e63a3153f1661b887f2',ramdisk_id='',reservation_id='r-o85sjwda',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2d99853e-ce24-4fe1-8395-d1e6463fd33d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546482846',owner_user_name='tempest-TestMinimumBasicScenario-546482846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:49:00Z,user_data=None,user_id='b8f9992958464143ac94c697f6d23920',uuid=44f05803-a6e1-4ceb-bbc5-97e343c2bc25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converting VIF {"id": "e46efeef-6f27-406b-89df-2b488d6f8626", "address": "fa:16:3e:21:cd:75", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape46efeef-6f", "ovs_interfaceid": "e46efeef-6f27-406b-89df-2b488d6f8626", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG os_vif [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape46efeef-6f, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81dd6040-0a03-40c6-a615-93ff37f38b24) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:51:38 user nova-compute[76815]: INFO os_vif [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:cd:75,bridge_name='br-int',has_traffic_filtering=True,id=e46efeef-6f27-406b-89df-2b488d6f8626,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape46efeef-6f')
Nov 14 22:51:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Deleting instance files /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25_del
Nov 14 22:51:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Deletion of /opt/stack/data/nova/instances/44f05803-a6e1-4ceb-bbc5-97e343c2bc25_del complete
Nov 14 22:51:38 user nova-compute[76815]: INFO nova.compute.manager [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 22:51:38 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:51:38 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:51:39 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:51:39 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Took 0.61 seconds to deallocate network for instance.
Nov 14 22:51:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-6b236d5c-f544-4fdf-a369-e453dad62119 req-7c72b1a8-88d2-493b-a810-7918c6cfb5e0 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-deleted-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:51:39 user nova-compute[76815]: INFO nova.compute.manager [req-6b236d5c-f544-4fdf-a369-e453dad62119 req-7c72b1a8-88d2-493b-a810-7918c6cfb5e0 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Neutron deleted interface e46efeef-6f27-406b-89df-2b488d6f8626; detaching it from the instance and deleting it from the info cache
Nov 14 22:51:39 user nova-compute[76815]: DEBUG nova.network.neutron [req-6b236d5c-f544-4fdf-a369-e453dad62119 req-7c72b1a8-88d2-493b-a810-7918c6cfb5e0 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:51:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-6b236d5c-f544-4fdf-a369-e453dad62119 req-7c72b1a8-88d2-493b-a810-7918c6cfb5e0 service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Detach interface failed, port_id=e46efeef-6f27-406b-89df-2b488d6f8626, reason: Instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25 could not be found. {{(pid=76815) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 22:51:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:39 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:51:39 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:51:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:39 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Deleted allocations for instance 44f05803-a6e1-4ceb-bbc5-97e343c2bc25
Nov 14 22:51:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-f140ee7b-1683-4296-9a34-10d1339852bd tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.788s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-f8323d80-8087-4733-b260-86f1fd48a77d req-b627a29f-9a0b-4e1f-bfff-e531abf46c4b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:51:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f8323d80-8087-4733-b260-86f1fd48a77d req-b627a29f-9a0b-4e1f-bfff-e531abf46c4b service nova] Acquiring lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f8323d80-8087-4733-b260-86f1fd48a77d req-b627a29f-9a0b-4e1f-bfff-e531abf46c4b service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:40 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-f8323d80-8087-4733-b260-86f1fd48a77d req-b627a29f-9a0b-4e1f-bfff-e531abf46c4b service nova] Lock "44f05803-a6e1-4ceb-bbc5-97e343c2bc25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:40 user nova-compute[76815]: DEBUG nova.compute.manager [req-f8323d80-8087-4733-b260-86f1fd48a77d req-b627a29f-9a0b-4e1f-bfff-e531abf46c4b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] No waiting events found dispatching network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:51:40 user nova-compute[76815]: WARNING nova.compute.manager [req-f8323d80-8087-4733-b260-86f1fd48a77d req-b627a29f-9a0b-4e1f-bfff-e531abf46c4b service nova] [instance: 44f05803-a6e1-4ceb-bbc5-97e343c2bc25] Received unexpected event network-vif-plugged-e46efeef-6f27-406b-89df-2b488d6f8626 for instance with vm_state deleted and task_state None.
Nov 14 22:51:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:43 user nova-compute[76815]: INFO nova.compute.manager [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attaching volume cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c to /dev/vdb
Nov 14 22:51:43 user nova-compute[76815]: DEBUG os_brick.utils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e1f995-2df6-4def-b832-d6ac9e1929b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b984639f-ebc9-4e92-b7a9-c16511616dba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8165ff4-c984-48a7-a582-1c850afe7c10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[802dceda-c749-4740-9579-d8a3d9291fc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:51:43 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:51:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4d13ce-93ce-4204-953b-90e7db66f3b1]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG os_brick.utils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating existing volume attachment record: a19ed707-14e6-4df4-acfd-6f5aa0412362 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:51:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSNPoTbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:51:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:51:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:51:47 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e348ddba-f4a0-4e5f-bb24-e7aed206f382]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:51:47 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[183ce118-c654-486c-adf8-2fe4fed5b271]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c] added
Nov 14 22:51:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efb27bc-325c-4478-b1c1-5586199b8644]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8657f0b2-13f3-4e0b-8efc-d8074c693531]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSNPoTbM {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSNPoTbM" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d8d4bf-a025-4c55-91f3-c8793616c0cf]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dSNPoTbM'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[18acdc2b-c88e-48fe-a7ee-a880039007ba]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb7b69-b637-4fc2-ab88-001a2f4b8661]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:51:47 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:51:47 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:51:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:51:47 user nova-compute[76815]: 
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[284bd722-82da-44b0-a1f1-75a2e261fa8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c, portal: 172.16.0.220,3260]
Nov 14 22:51:47 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c, portal: 172.16.0.220,3260] successful.
Nov 14 22:51:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dba669-995e-4704-bab2-1e6389b69bc3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5150b287-79cc-4157-a50d-5c1a4235e065]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c (non-flash)
Nov 14 22:51:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c (non-flash)
Nov 14 22:51:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f092d2-97c9-43e4-8c6b-3cdc262b7f31]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:51:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:51:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSNPoTbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:51:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:51:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26431323930623164', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:51:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431323930623164', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:51:48 user nova-compute[76815]: DEBUG nova.objects.instance [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:51:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:51:49 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:51:49 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:51:49 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:51:49 user nova-compute[76815]:   <serial>cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c</serial>
Nov 14 22:51:49 user nova-compute[76815]: </disk>
Nov 14 22:51:49 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:51:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:51:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:51:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No VIF found with MAC fa:16:3e:40:2f:bb, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:51:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-3c8e559c-e174-4983-a063-2aa90b9e4a64 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.180s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:51:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:51:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:51:51 user nova-compute[76815]: INFO nova.compute.manager [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Detaching volume cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c
Nov 14 22:51:51 user nova-compute[76815]: INFO nova.virt.block_device [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attempting to driver detach volume cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c from mountpoint /dev/vdb
Nov 14 22:51:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Attempting to detach device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:51:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:51:51 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:51:51 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:51:51 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:51:51 user nova-compute[76815]:   <serial>cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c</serial>
Nov 14 22:51:51 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:51:51 user nova-compute[76815]: </disk>
Nov 14 22:51:51 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:51:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully detached device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the persistent domain config.
Nov 14 22:51:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:51:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:51:51 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:51:51 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:51:51 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:51:51 user nova-compute[76815]:   <serial>cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c</serial>
Nov 14 22:51:51 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:51:51 user nova-compute[76815]: </disk>
Nov 14 22:51:51 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:51:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:51:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:51:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating instance_info_cache with network_info: [{"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:07 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:08 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:52:08 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:52:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=24.956905364990234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:52:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:52:11 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa is timed out.
Nov 14 22:52:11 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully detached device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the live domain config.
Nov 14 22:52:11 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSNPoTbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:52:11 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[99161d98-d6e1-4e7b-8153-1074bb2f2b3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:52:11 user nova-compute[76815]: No targets found.
Nov 14 22:52:11 user nova-compute[76815]: iSNS:
Nov 14 22:52:11 user nova-compute[76815]: No targets found.
Nov 14 22:52:11 user nova-compute[76815]: STATIC:
Nov 14 22:52:11 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c
Nov 14 22:52:11 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:52:11 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:52:11 user nova-compute[76815]: FIRMWARE:
Nov 14 22:52:11 user nova-compute[76815]: No targets found.
Nov 14 22:52:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:52:11 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:52:11 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ec7b80-4034-4f04-b9e6-3383db1d3877]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd11c0e5-52e7-49c6-91a0-c8b86cb1cf52]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c (non-flash)
Nov 14 22:52:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c (non-flash)
Nov 14 22:52:11 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4536ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05c3354-ce05-4b3d-ac26-5470fd9740ed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[33737429-4ef4-4247-8f3f-f3d44a77c6d0]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:52:11 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a230b-c811-4498-bcc7-c24d2c0b2699]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[83667562-b133-4c07-9568-d86b759d44f0]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[727b88a8-b791-467a-9b6c-f30568cffd87]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef54e5db-6fdb-4f49-8e56-b6cec75526a9]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c, portal: 172.16.0.220,3260]
Nov 14 22:52:12 user nova-compute[76815]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c, portal: 172.16.0.220,3260] successful.
Nov 14 22:52:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2eaaa1-18c1-4c72-9a71-5c45925ceb9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf1df9-acd4-40f2-b0f4-d5fc3492301e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== disconnect_volume: return (279ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG nova.objects.instance [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:52:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cb714e2a-c28e-4d03-807c-72adb7ff98a3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.568s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:52:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:22 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:52:32 user nova-compute[76815]: INFO nova.compute.claims [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Claim successful on node user
Nov 14 22:52:32 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:52:32 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:52:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:52:32 user nova-compute[76815]: DEBUG nova.policy [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8f9992958464143ac94c697f6d23920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769ed1e318574e63a3153f1661b887f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:52:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Creating image(s)
Nov 14 22:52:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "/opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "/opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "/opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "261870a58dbb1144cf9d2641a403369f75c3d3f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "261870a58dbb1144cf9d2641a403369f75c3d3f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6.part --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Successfully created port: d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6.part --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG nova.virt.images [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] 8001aec6-054e-49f5-874b-d4eb3d7c84a1 was qcow2, converting to raw {{(pid=76815) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG nova.privsep.utils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=76815) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6.part /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6.converted {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6.part /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6.converted" returned: 0 in 0.362s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6.converted --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "261870a58dbb1144cf9d2641a403369f75c3d3f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.252s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Successfully updated port: d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-3b24f129-f2f3-48df-a94a-bb21eea5faec req-a029ec70-f159-40e9-9ba9-4af094a3490f service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-changed-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-3b24f129-f2f3-48df-a94a-bb21eea5faec req-a029ec70-f159-40e9-9ba9-4af094a3490f service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing instance network info cache due to event network-changed-d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3b24f129-f2f3-48df-a94a-bb21eea5faec req-a029ec70-f159-40e9-9ba9-4af094a3490f service nova] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6 --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "261870a58dbb1144cf9d2641a403369f75c3d3f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "261870a58dbb1144cf9d2641a403369f75c3d3f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6 --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6,backing_fmt=raw /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6,backing_fmt=raw /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk 1073741824" returned: 0 in 0.047s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "261870a58dbb1144cf9d2641a403369f75c3d3f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6 --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG nova.network.neutron [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Instance network_info: |[{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3b24f129-f2f3-48df-a94a-bb21eea5faec req-a029ec70-f159-40e9-9ba9-4af094a3490f service nova] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-3b24f129-f2f3-48df-a94a-bb21eea5faec req-a029ec70-f159-40e9-9ba9-4af094a3490f service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing network info cache for port d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/261870a58dbb1144cf9d2641a403369f75c3d3f6 --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:52:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Cannot resize image /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Ensure instance console log exists: /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Start _get_guest_xml network_info=[{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:52:30Z,direct_url=<?>,disk_format='qcow2',id=8001aec6-054e-49f5-874b-d4eb3d7c84a1,min_disk=0,min_ram=0,name='tempest-scenario-img--1715830916',owner='769ed1e318574e63a3153f1661b887f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:52:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '8001aec6-054e-49f5-874b-d4eb3d7c84a1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:52:35 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:52:35 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:52:30Z,direct_url=<?>,disk_format='qcow2',id=8001aec6-054e-49f5-874b-d4eb3d7c84a1,min_disk=0,min_ram=0,name='tempest-scenario-img--1715830916',owner='769ed1e318574e63a3153f1661b887f2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:52:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-934772048',display_name='tempest-TestMinimumBasicScenario-server-934772048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-934772048',id=52,image_ref='8001aec6-054e-49f5-874b-d4eb3d7c84a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrMS1QcJEoEqAd/TMAOVokkPCBLEOYEi2I433O52XsuDu+b0zi1NVfpzwkEVYscDGVogCCIND4sZKxDv1jVVT2v9tGBxhbfiqT8yadwiHeQKZYLfG4EBhAQfvHI0jiKuQ==',key_name='tempest-TestMinimumBasicScenario-105758653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='769ed1e318574e63a3153f1661b887f2',ramdisk_id='',reservation_id='r-4wzy0iav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8001aec6-054e-49f5-874b-d4eb3d7c84a1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546482846',owner_user_name='tempest-TestMinimumBasicScenario-546482846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:52:33Z,user_data=None,user_id='b8f9992958464143ac94c697f6d23920',uuid=28a08c9f-a6d5-4299-afe3-c43f3c2803c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converting VIF {"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=d689c59f-c00c-453d-a08d-03e94a678283,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd689c59f-c0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.objects.instance [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'pci_devices' on Instance uuid 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-3b24f129-f2f3-48df-a94a-bb21eea5faec req-a029ec70-f159-40e9-9ba9-4af094a3490f service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updated VIF entry in instance network info cache for port d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.network.neutron [req-3b24f129-f2f3-48df-a94a-bb21eea5faec req-a029ec70-f159-40e9-9ba9-4af094a3490f service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:52:35 user nova-compute[76815]:   <uuid>28a08c9f-a6d5-4299-afe3-c43f3c2803c7</uuid>
Nov 14 22:52:35 user nova-compute[76815]:   <name>instance-00000034</name>
Nov 14 22:52:35 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:52:35 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:52:35 user nova-compute[76815]:   <metadata>
Nov 14 22:52:35 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:52:35 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:52:35 user nova-compute[76815]:       <nova:name>tempest-TestMinimumBasicScenario-server-934772048</nova:name>
Nov 14 22:52:35 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:52:35</nova:creationTime>
Nov 14 22:52:35 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:52:35 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:52:35 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:52:35 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:52:35 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:52:35 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:52:35 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:52:35 user nova-compute[76815]:       <nova:owner>
Nov 14 22:52:35 user nova-compute[76815]:         <nova:user uuid="b8f9992958464143ac94c697f6d23920">tempest-TestMinimumBasicScenario-546482846-project-member</nova:user>
Nov 14 22:52:35 user nova-compute[76815]:         <nova:project uuid="769ed1e318574e63a3153f1661b887f2">tempest-TestMinimumBasicScenario-546482846</nova:project>
Nov 14 22:52:35 user nova-compute[76815]:       </nova:owner>
Nov 14 22:52:35 user nova-compute[76815]:       <nova:root type="image" uuid="8001aec6-054e-49f5-874b-d4eb3d7c84a1"/>
Nov 14 22:52:35 user nova-compute[76815]:       <nova:ports>
Nov 14 22:52:35 user nova-compute[76815]:         <nova:port uuid="d689c59f-c00c-453d-a08d-03e94a678283">
Nov 14 22:52:35 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 22:52:35 user nova-compute[76815]:         </nova:port>
Nov 14 22:52:35 user nova-compute[76815]:       </nova:ports>
Nov 14 22:52:35 user nova-compute[76815]:     </nova:instance>
Nov 14 22:52:35 user nova-compute[76815]:   </metadata>
Nov 14 22:52:35 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:52:35 user nova-compute[76815]:     <system>
Nov 14 22:52:35 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:52:35 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:52:35 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:52:35 user nova-compute[76815]:       <entry name="serial">28a08c9f-a6d5-4299-afe3-c43f3c2803c7</entry>
Nov 14 22:52:35 user nova-compute[76815]:       <entry name="uuid">28a08c9f-a6d5-4299-afe3-c43f3c2803c7</entry>
Nov 14 22:52:35 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:52:35 user nova-compute[76815]:     </system>
Nov 14 22:52:35 user nova-compute[76815]:   </sysinfo>
Nov 14 22:52:35 user nova-compute[76815]:   <os>
Nov 14 22:52:35 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:52:35 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:52:35 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:52:35 user nova-compute[76815]:   </os>
Nov 14 22:52:35 user nova-compute[76815]:   <features>
Nov 14 22:52:35 user nova-compute[76815]:     <acpi/>
Nov 14 22:52:35 user nova-compute[76815]:     <apic/>
Nov 14 22:52:35 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:52:35 user nova-compute[76815]:   </features>
Nov 14 22:52:35 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:52:35 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:52:35 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:52:35 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:52:35 user nova-compute[76815]:   </clock>
Nov 14 22:52:35 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:52:35 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:52:35 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:52:35 user nova-compute[76815]:   </cpu>
Nov 14 22:52:35 user nova-compute[76815]:   <devices>
Nov 14 22:52:35 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:52:35 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:52:35 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk"/>
Nov 14 22:52:35 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:52:35 user nova-compute[76815]:     </disk>
Nov 14 22:52:35 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:52:35 user nova-compute[76815]:       <mac address="fa:16:3e:92:92:6c"/>
Nov 14 22:52:35 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:52:35 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:52:35 user nova-compute[76815]:       <target dev="tapd689c59f-c0"/>
Nov 14 22:52:35 user nova-compute[76815]:     </interface>
Nov 14 22:52:35 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:52:35 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/console.log" append="off"/>
Nov 14 22:52:35 user nova-compute[76815]:     </serial>
Nov 14 22:52:35 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:52:35 user nova-compute[76815]:     <video>
Nov 14 22:52:35 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:52:35 user nova-compute[76815]:     </video>
Nov 14 22:52:35 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:52:35 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:52:35 user nova-compute[76815]:     </rng>
Nov 14 22:52:35 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:52:35 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:52:35 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:52:35 user nova-compute[76815]:     </memballoon>
Nov 14 22:52:35 user nova-compute[76815]:   </devices>
Nov 14 22:52:35 user nova-compute[76815]: </domain>
Nov 14 22:52:35 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-934772048',display_name='tempest-TestMinimumBasicScenario-server-934772048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-934772048',id=52,image_ref='8001aec6-054e-49f5-874b-d4eb3d7c84a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrMS1QcJEoEqAd/TMAOVokkPCBLEOYEi2I433O52XsuDu+b0zi1NVfpzwkEVYscDGVogCCIND4sZKxDv1jVVT2v9tGBxhbfiqT8yadwiHeQKZYLfG4EBhAQfvHI0jiKuQ==',key_name='tempest-TestMinimumBasicScenario-105758653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='769ed1e318574e63a3153f1661b887f2',ramdisk_id='',reservation_id='r-4wzy0iav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8001aec6-054e-49f5-874b-d4eb3d7c84a1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-546482846',owner_user_name='tempest-TestMinimumBasicScenario-546482846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:52:33Z,user_data=None,user_id='b8f9992958464143ac94c697f6d23920',uuid=28a08c9f-a6d5-4299-afe3-c43f3c2803c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converting VIF {"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=d689c59f-c00c-453d-a08d-03e94a678283,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd689c59f-c0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG os_vif [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=d689c59f-c00c-453d-a08d-03e94a678283,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd689c59f-c0') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3b24f129-f2f3-48df-a94a-bb21eea5faec req-a029ec70-f159-40e9-9ba9-4af094a3490f service nova] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75b01365-24c9-536a-a148-80ab9261b49b', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd689c59f-c0, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd689c59f-c0, col_values=(('qos', UUID('9fa15bc4-2ae5-4794-a43a-2b7adc9e0682')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd689c59f-c0, col_values=(('external_ids', {'iface-id': 'd689c59f-c00c-453d-a08d-03e94a678283', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:92:6c', 'vm-uuid': '28a08c9f-a6d5-4299-afe3-c43f3c2803c7'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:35 user nova-compute[76815]: INFO os_vif [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=d689c59f-c00c-453d-a08d-03e94a678283,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd689c59f-c0')
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:52:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No VIF found with MAC fa:16:3e:92:92:6c, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:52:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-cec1bf0e-d0fd-49f5-bf08-2a22e439c694 req-b8068c20-1492-474f-ba9f-9dbd2b467272 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:52:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cec1bf0e-d0fd-49f5-bf08-2a22e439c694 req-b8068c20-1492-474f-ba9f-9dbd2b467272 service nova] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cec1bf0e-d0fd-49f5-bf08-2a22e439c694 req-b8068c20-1492-474f-ba9f-9dbd2b467272 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cec1bf0e-d0fd-49f5-bf08-2a22e439c694 req-b8068c20-1492-474f-ba9f-9dbd2b467272 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-cec1bf0e-d0fd-49f5-bf08-2a22e439c694 req-b8068c20-1492-474f-ba9f-9dbd2b467272 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] No waiting events found dispatching network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:52:36 user nova-compute[76815]: WARNING nova.compute.manager [req-cec1bf0e-d0fd-49f5-bf08-2a22e439c694 req-b8068c20-1492-474f-ba9f-9dbd2b467272 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received unexpected event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 for instance with vm_state building and task_state spawning.
Nov 14 22:52:36 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:52:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Instance spawned successfully.
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-7e19a6e8-9005-4b25-a533-aa967c5c550e req-848377a3-0387-48c1-8e45-3cc83b4f3a60 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7e19a6e8-9005-4b25-a533-aa967c5c550e req-848377a3-0387-48c1-8e45-3cc83b4f3a60 service nova] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7e19a6e8-9005-4b25-a533-aa967c5c550e req-848377a3-0387-48c1-8e45-3cc83b4f3a60 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7e19a6e8-9005-4b25-a533-aa967c5c550e req-848377a3-0387-48c1-8e45-3cc83b4f3a60 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.compute.manager [req-7e19a6e8-9005-4b25-a533-aa967c5c550e req-848377a3-0387-48c1-8e45-3cc83b4f3a60 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] No waiting events found dispatching network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:52:38 user nova-compute[76815]: WARNING nova.compute.manager [req-7e19a6e8-9005-4b25-a533-aa967c5c550e req-848377a3-0387-48c1-8e45-3cc83b4f3a60 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received unexpected event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 for instance with vm_state building and task_state spawning.
Nov 14 22:52:38 user nova-compute[76815]: INFO nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 14 22:52:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:52:39 user nova-compute[76815]: INFO nova.compute.manager [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Took 6.56 seconds to build instance.
Nov 14 22:52:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-a8958c72-d7bb-4459-a181-d9ba0ac1ee5d tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.667s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:43 user nova-compute[76815]: INFO nova.compute.manager [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attaching volume 05fa1c09-62c4-4dea-913d-8dd2fd7a492f to /dev/vdb
Nov 14 22:52:43 user nova-compute[76815]: DEBUG os_brick.utils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c562c4-b30f-466d-b1f0-13b5b762bf43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4bb082-0634-4bcd-9d00-7c273c2fdc76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b055aaac-601f-4c53-86ea-66b47e93c296]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a30994-e6c9-4dc6-b8eb-6727f1d8aaf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:52:43 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:52:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9812776a-30c5-4824-a00a-7c7abfd3ce92]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG os_brick.utils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:52:43 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating existing volume attachment record: e8f84785-6572-48ad-a306-a596a8554675 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:52:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQMpUsBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:52:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:52:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:52:47 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[342706e0-69eb-4f08-843a-2eb87b9e3afa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:52:47 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[952c7c82-93bf-460d-9c79-00d519ff33a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f] added
Nov 14 22:52:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2b2a3-77c6-40e0-ad2f-f211ebedb3d6]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b056a5b8-122c-4091-b04b-862d9d59c10f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQMpUsBA {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQMpUsBA" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[072e5287-1c15-4fc6-ad2c-c908a52097c8]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bQMpUsBA'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4c9957-4151-47f4-add1-e56353b8fbbb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df56d363-a7b3-4dee-bb8e-c1716de505a8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:52:47 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:52:47 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:52:47 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:52:47 user nova-compute[76815]: 
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea12328-d3ab-4f2c-b6dc-f59703db320e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f, portal: 172.16.0.220,3260]
Nov 14 22:52:47 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f, portal: 172.16.0.220,3260] successful.
Nov 14 22:52:47 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7b6c15-9f6f-43cc-a6a1-64bcb5156628]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:52:47 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc458caa-5fd3-443b-bd87-a73464c75961]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f (non-flash)
Nov 14 22:52:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f (non-flash)
Nov 14 22:52:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85949fc4-5411-4bee-9009-ce2365ffd980]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:52:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQMpUsBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:52:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:52:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26163343234643935', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:52:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163343234643935', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:52:49 user nova-compute[76815]: DEBUG nova.objects.instance [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:52:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:52:49 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:52:49 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:52:49 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:52:49 user nova-compute[76815]:   <serial>05fa1c09-62c4-4dea-913d-8dd2fd7a492f</serial>
Nov 14 22:52:49 user nova-compute[76815]: </disk>
Nov 14 22:52:49 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:52:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:52:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:52:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No VIF found with MAC fa:16:3e:40:2f:bb, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:52:49 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-e046e63a-dc69-47fc-a9bb-d40c14eae008 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.105s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:52:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:52:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:52:51 user nova-compute[76815]: INFO nova.compute.manager [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Detaching volume 05fa1c09-62c4-4dea-913d-8dd2fd7a492f
Nov 14 22:52:51 user nova-compute[76815]: INFO nova.virt.block_device [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attempting to driver detach volume 05fa1c09-62c4-4dea-913d-8dd2fd7a492f from mountpoint /dev/vdb
Nov 14 22:52:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Attempting to detach device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:52:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:52:51 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:52:51 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:52:51 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:52:51 user nova-compute[76815]:   <serial>05fa1c09-62c4-4dea-913d-8dd2fd7a492f</serial>
Nov 14 22:52:51 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:52:51 user nova-compute[76815]: </disk>
Nov 14 22:52:51 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:52:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully detached device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the persistent domain config.
Nov 14 22:52:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:52:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:52:51 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:52:51 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:52:51 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:52:51 user nova-compute[76815]:   <serial>05fa1c09-62c4-4dea-913d-8dd2fd7a492f</serial>
Nov 14 22:52:51 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:52:51 user nova-compute[76815]: </disk>
Nov 14 22:52:51 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:52:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:52:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:52:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:07 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:53:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating instance_info_cache with network_info: [{"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:10 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:53:10 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:53:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=24.905956268310547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:53:10 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:53:11 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:53:11 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:53:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:53:11 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:53:12 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa is timed out.
Nov 14 22:53:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully detached device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the live domain config.
Nov 14 22:53:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQMpUsBA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:53:12 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd7c81b-a017-4ed5-b460-bdb7a5c27339]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:53:12 user nova-compute[76815]: No targets found.
Nov 14 22:53:12 user nova-compute[76815]: iSNS:
Nov 14 22:53:12 user nova-compute[76815]: No targets found.
Nov 14 22:53:12 user nova-compute[76815]: STATIC:
Nov 14 22:53:12 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f
Nov 14 22:53:12 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:53:12 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:53:12 user nova-compute[76815]: FIRMWARE:
Nov 14 22:53:12 user nova-compute[76815]: No targets found.
Nov 14 22:53:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:53:12 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:53:12 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62a63f-ece6-40a2-a915-f663823da2fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[922b83da-5466-42c7-b77c-cb102ece2fb5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f (non-flash)
Nov 14 22:53:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f (non-flash)
Nov 14 22:53:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c87524d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a582da-b6c1-439c-ba81-7a7386c16d91]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[07017a93-ba39-42b8-b301-5b99a533109d]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f4d6ad-b69e-49c4-bbf9-bdcd4a668fb3]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d12c6c-38f3-45d4-b2c7-f347ae8f5a00]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c58d79-69f3-4ba5-8074-a14ef67b98ad]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1aede7-fee3-43b9-ad30-1fe79628d39a]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f, portal: 172.16.0.220,3260]
Nov 14 22:53:12 user nova-compute[76815]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f, portal: 172.16.0.220,3260] successful.
Nov 14 22:53:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05fa1c09-62c4-4dea-913d-8dd2fd7a492f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb694e2d-f31e-4daf-bb35-b25a8ebc0bfd]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== disconnect_volume: return (286ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:53:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:53:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:53:13 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:53:13 user nova-compute[76815]: DEBUG nova.objects.instance [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:53:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-37306863-c368-4c81-9cf9-a3902385bfc3 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.578s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:53:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:53:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:53:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:53:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:53:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:53:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:53:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:53:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:53:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:53:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:53:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:53:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:53:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG nova.objects.instance [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:53:43 user nova-compute[76815]: INFO nova.compute.manager [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attaching volume e16d5917-b59e-4fc7-bcc4-582981ffd54d to /dev/vdb
Nov 14 22:53:43 user nova-compute[76815]: DEBUG os_brick.utils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f9b935-6624-404e-ae8d-1f899a8e3f17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c73ffc-af2f-4ede-a6a5-b791191f9da9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[feec071f-40c2-4a37-b588-97d0247e5332]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebe196f-4a39-436a-b4ed-9b90308b962a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:43 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:53:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:53:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:44 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:53:44 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:53:44 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91d0871-77d7-43cd-8125-d89a491fcef7]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:53:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:53:44 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:53:44 user nova-compute[76815]: DEBUG os_brick.utils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:53:44 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating existing volume attachment record: 4edf0269-e3da-483e-8980-25a5f7bcddec {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:53:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipnecdCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:53:48 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:53:48 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:53:48 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f2c2df-7782-4b32-8715-9d305335a8cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:53:48 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2215fd28-b36d-4161-8a00-89fe0652fe1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d] added
Nov 14 22:53:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec46c18-ed0c-4cac-a6f4-5e0b6646e28e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccfa7f6-f6ea-4522-b183-80f28caa5760]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipnecdCj {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipnecdCj" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42640c7-df90-42b9-9717-5ae05c377d4c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipnecdCj'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e9a94e-6a32-4a8f-a5a4-287551494354]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1aec66-f476-415d-9d60-d3728be53b68]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:53:48 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:53:48 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:53:48 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:53:48 user nova-compute[76815]: 
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad94314-57ea-44e8-813e-f9075231d3e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d, portal: 172.16.0.220,3260]
Nov 14 22:53:48 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d, portal: 172.16.0.220,3260] successful.
Nov 14 22:53:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3945c6-4658-4330-8f4b-88ab4fd4ef37]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c360bf97-9ad7-4b60-b38d-83169d33cbc6]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d (non-flash)
Nov 14 22:53:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d (non-flash)
Nov 14 22:53:48 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaef7c1-1563-4d77-b9cf-48970448c8fe]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:53:48 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipnecdCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:53:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:53:49 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26630323862393066', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:53:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630323862393066', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:53:49 user nova-compute[76815]: DEBUG nova.objects.instance [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:53:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:53:49 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:53:49 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:53:49 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:53:49 user nova-compute[76815]:   <serial>e16d5917-b59e-4fc7-bcc4-582981ffd54d</serial>
Nov 14 22:53:49 user nova-compute[76815]: </disk>
Nov 14 22:53:49 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:53:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:53:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:53:49 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] No VIF found with MAC fa:16:3e:40:2f:bb, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:53:50 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b21016e-6bbb-40ad-970b-0abb15c81646 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.195s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:53:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:53:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:53:51 user nova-compute[76815]: INFO nova.compute.manager [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Detaching volume e16d5917-b59e-4fc7-bcc4-582981ffd54d
Nov 14 22:53:51 user nova-compute[76815]: INFO nova.virt.block_device [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Attempting to driver detach volume e16d5917-b59e-4fc7-bcc4-582981ffd54d from mountpoint /dev/vdb
Nov 14 22:53:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Attempting to detach device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:53:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:53:51 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:53:51 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:53:51 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:53:51 user nova-compute[76815]:   <serial>e16d5917-b59e-4fc7-bcc4-582981ffd54d</serial>
Nov 14 22:53:51 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:53:51 user nova-compute[76815]: </disk>
Nov 14 22:53:51 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:53:51 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully detached device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the persistent domain config.
Nov 14 22:53:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:53:51 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:53:51 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:53:51 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:53:51 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:53:51 user nova-compute[76815]:   <serial>e16d5917-b59e-4fc7-bcc4-582981ffd54d</serial>
Nov 14 22:53:51 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:53:51 user nova-compute[76815]: </disk>
Nov 14 22:53:51 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:53:52 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:53:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:53:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:54:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:54:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:54:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:54:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:54:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:54:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:09 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:10 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:54:10 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:54:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=24.90494155883789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:54:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:11 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:54:11 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:54:11 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:54:11 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:54:11 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:54:11 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:54:11 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:54:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:12 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa is timed out.
Nov 14 22:54:12 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully detached device vdb from instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa from the live domain config.
Nov 14 22:54:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipnecdCj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:54:12 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea9e332-ceb9-47d7-be1f-0e033aaec4ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:54:12 user nova-compute[76815]: No targets found.
Nov 14 22:54:12 user nova-compute[76815]: iSNS:
Nov 14 22:54:12 user nova-compute[76815]: No targets found.
Nov 14 22:54:12 user nova-compute[76815]: STATIC:
Nov 14 22:54:12 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d
Nov 14 22:54:12 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:54:12 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:54:12 user nova-compute[76815]: FIRMWARE:
Nov 14 22:54:12 user nova-compute[76815]: No targets found.
Nov 14 22:54:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:54:12 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:54:12 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1c63b1-768f-477d-bf55-b98d5349e7ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a2ff5e-c4e8-4bbb-b4bb-da3232619dc1]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d (non-flash)
Nov 14 22:54:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d (non-flash)
Nov 14 22:54:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c862a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4ef6d2-db5c-486f-9759-6d7c9d1f14ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ad9d3b-4cd5-4a3b-85bc-6ed2e409b1df]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8195e466-53ab-45b5-aadc-c8fe120d44c9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a595929a-d65b-425e-b29f-e12c1e4b6f91]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8db6a8-d86d-40db-a065-eb9c8bf5e92b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a238f267-5d5e-4989-ba83-d439c089f7e0]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d, portal: 172.16.0.220,3260]
Nov 14 22:54:12 user nova-compute[76815]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d, portal: 172.16.0.220,3260] successful.
Nov 14 22:54:12 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16d5917-b59e-4fc7-bcc4-582981ffd54d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[51803b21-4f9b-4590-82fc-25ccc34e7bdd]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] <== disconnect_volume: return (294ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:54:12 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:54:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:13 user nova-compute[76815]: DEBUG nova.objects.instance [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'flavor' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:54:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-791b0000-35db-475c-b96a-0949a471c428 tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.605s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:14 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:54:15 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:18 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:54:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:54:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:54:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG nova.objects.instance [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'flavor' on Instance uuid 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:24 user nova-compute[76815]: INFO nova.compute.manager [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Attaching volume c255d21c-cec4-4347-8304-62992ed9d90e to /dev/vdb
Nov 14 22:54:24 user nova-compute[76815]: DEBUG os_brick.utils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dae9d7-931d-445b-a145-29e891eb0576]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9396683-f376-4bcd-a777-a737315cf7a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db774f-584c-44e4-bc1e-72a5313a8324]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05b7ccb-cfd3-4037-bb4a-c789d3887629]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 22:54:24 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 22:54:24 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[938f83ea-79cb-4608-9d03-bbdf694f250c]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG os_brick.utils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:54:24 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating existing volume attachment record: 4f42cdf0-215b-4f64-abaa-26db7ac75dbf {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 22:54:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKLSUjWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:54:30 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:54:30 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:54:30 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d40def4-079b-49a3-ae7b-4155f89dd026]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 22:54:30 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcba72c-adda-4e45-bf99-895a89e1ae49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e] added
Nov 14 22:54:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ab9390-fdf7-4865-a771-e62044c461a5]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064166c-fb68-45d7-96fe-96d6d56fef78]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKLSUjWi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKLSUjWi" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b857ba71-3c2f-4c3b-b34f-aa069c41c573]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pKLSUjWi'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfa4836-e8e9-4637-ba4c-305a437b785c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbfd79e-30d1-4afa-9d54-9e454e4b7fd7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:54:30 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 22:54:30 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:54:30 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 22:54:30 user nova-compute[76815]: 
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7074519e-310f-40cb-8475-b0ddaef55ca7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e, portal: 172.16.0.220,3260]
Nov 14 22:54:30 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e, portal: 172.16.0.220,3260] successful.
Nov 14 22:54:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aae512-8e1d-418b-9825-5de3a8c25f0f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[597a5d69-83c6-49bc-b2ff-f887e376032c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e (non-flash)
Nov 14 22:54:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e (non-flash)
Nov 14 22:54:30 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0553bc3-00b3-41bd-bc44-0ef26081d3f5]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 22:54:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKLSUjWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 22:54:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:54:31 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23161356338346565', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:54:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161356338346565', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 22:54:31 user nova-compute[76815]: DEBUG nova.objects.instance [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'flavor' on Instance uuid 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:54:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 22:54:31 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:54:31 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:54:31 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:54:31 user nova-compute[76815]:   <serial>c255d21c-cec4-4347-8304-62992ed9d90e</serial>
Nov 14 22:54:31 user nova-compute[76815]: </disk>
Nov 14 22:54:31 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 22:54:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:54:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:54:31 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] No VIF found with MAC fa:16:3e:92:92:6c, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:54:32 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:54:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-cd53a663-de4f-4c25-a65c-94a0f7be5db3 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.385s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:54:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:54:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-7fb352f1-8b3e-4028-99e0-40a5e8f8a980 req-3fb2e470-c9aa-49fe-9670-9f24d21e01b3 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-changed-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:54:34 user nova-compute[76815]: DEBUG nova.compute.manager [req-7fb352f1-8b3e-4028-99e0-40a5e8f8a980 req-3fb2e470-c9aa-49fe-9670-9f24d21e01b3 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing instance network info cache due to event network-changed-d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:54:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7fb352f1-8b3e-4028-99e0-40a5e8f8a980 req-3fb2e470-c9aa-49fe-9670-9f24d21e01b3 service nova] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:54:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7fb352f1-8b3e-4028-99e0-40a5e8f8a980 req-3fb2e470-c9aa-49fe-9670-9f24d21e01b3 service nova] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:54:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-7fb352f1-8b3e-4028-99e0-40a5e8f8a980 req-3fb2e470-c9aa-49fe-9670-9f24d21e01b3 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing network info cache for port d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:54:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-7fb352f1-8b3e-4028-99e0-40a5e8f8a980 req-3fb2e470-c9aa-49fe-9670-9f24d21e01b3 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updated VIF entry in instance network info cache for port d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:54:34 user nova-compute[76815]: DEBUG nova.network.neutron [req-7fb352f1-8b3e-4028-99e0-40a5e8f8a980 req-3fb2e470-c9aa-49fe-9670-9f24d21e01b3 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:54:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-7fb352f1-8b3e-4028-99e0-40a5e8f8a980 req-3fb2e470-c9aa-49fe-9670-9f24d21e01b3 service nova] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:54:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-656433b4-b8c9-4ef7-8057-19db3a064878 req-53211800-e8b2-470e-aefe-94f2254f6f78 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-changed-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG nova.compute.manager [req-656433b4-b8c9-4ef7-8057-19db3a064878 req-53211800-e8b2-470e-aefe-94f2254f6f78 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing instance network info cache due to event network-changed-d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-656433b4-b8c9-4ef7-8057-19db3a064878 req-53211800-e8b2-470e-aefe-94f2254f6f78 service nova] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-656433b4-b8c9-4ef7-8057-19db3a064878 req-53211800-e8b2-470e-aefe-94f2254f6f78 service nova] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-656433b4-b8c9-4ef7-8057-19db3a064878 req-53211800-e8b2-470e-aefe-94f2254f6f78 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing network info cache for port d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-656433b4-b8c9-4ef7-8057-19db3a064878 req-53211800-e8b2-470e-aefe-94f2254f6f78 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updated VIF entry in instance network info cache for port d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG nova.network.neutron [req-656433b4-b8c9-4ef7-8057-19db3a064878 req-53211800-e8b2-470e-aefe-94f2254f6f78 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-656433b4-b8c9-4ef7-8057-19db3a064878 req-53211800-e8b2-470e-aefe-94f2254f6f78 service nova] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:36 user nova-compute[76815]: INFO nova.compute.manager [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Rebooting instance
Nov 14 22:54:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:54:36 user nova-compute[76815]: DEBUG nova.network.neutron [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:54:37 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:54:37 user nova-compute[76815]: DEBUG nova.network.neutron [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:54:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:54:37 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:54:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-96e9c1fd-1567-49a0-95d4-fdab3433afc4 req-581d09a3-9a04-4ca3-af67-6cb2cc1153f3 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-unplugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:54:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-96e9c1fd-1567-49a0-95d4-fdab3433afc4 req-581d09a3-9a04-4ca3-af67-6cb2cc1153f3 service nova] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-96e9c1fd-1567-49a0-95d4-fdab3433afc4 req-581d09a3-9a04-4ca3-af67-6cb2cc1153f3 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:39 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-96e9c1fd-1567-49a0-95d4-fdab3433afc4 req-581d09a3-9a04-4ca3-af67-6cb2cc1153f3 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:39 user nova-compute[76815]: DEBUG nova.compute.manager [req-96e9c1fd-1567-49a0-95d4-fdab3433afc4 req-581d09a3-9a04-4ca3-af67-6cb2cc1153f3 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] No waiting events found dispatching network-vif-unplugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:54:39 user nova-compute[76815]: WARNING nova.compute.manager [req-96e9c1fd-1567-49a0-95d4-fdab3433afc4 req-581d09a3-9a04-4ca3-af67-6cb2cc1153f3 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received unexpected event network-vif-unplugged-d689c59f-c00c-453d-a08d-03e94a678283 for instance with vm_state active and task_state reboot_started.
Nov 14 22:54:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:40 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Instance shutdown successfully.
Nov 14 22:54:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-96af8f6b-5871-4e3a-9c19-fe3efb75ce7d req-4aabd6ab-dcfb-489d-9de4-38ceb355e0f8 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:54:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-96af8f6b-5871-4e3a-9c19-fe3efb75ce7d req-4aabd6ab-dcfb-489d-9de4-38ceb355e0f8 service nova] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-96af8f6b-5871-4e3a-9c19-fe3efb75ce7d req-4aabd6ab-dcfb-489d-9de4-38ceb355e0f8 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-96af8f6b-5871-4e3a-9c19-fe3efb75ce7d req-4aabd6ab-dcfb-489d-9de4-38ceb355e0f8 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:41 user nova-compute[76815]: DEBUG nova.compute.manager [req-96af8f6b-5871-4e3a-9c19-fe3efb75ce7d req-4aabd6ab-dcfb-489d-9de4-38ceb355e0f8 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] No waiting events found dispatching network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:54:41 user nova-compute[76815]: WARNING nova.compute.manager [req-96af8f6b-5871-4e3a-9c19-fe3efb75ce7d req-4aabd6ab-dcfb-489d-9de4-38ceb355e0f8 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received unexpected event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 for instance with vm_state active and task_state reboot_started.
Nov 14 22:54:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Instance running successfully.
Nov 14 22:54:43 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Instance soft rebooted successfully.
Nov 14 22:54:43 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] No waiting events found dispatching network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:54:43 user nova-compute[76815]: WARNING nova.compute.manager [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received unexpected event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 for instance with vm_state active and task_state reboot_started.
Nov 14 22:54:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:43 user nova-compute[76815]: DEBUG nova.compute.manager [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] No waiting events found dispatching network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:54:43 user nova-compute[76815]: WARNING nova.compute.manager [req-3be9d039-9b3c-4fc7-9670-e5b3c7255ad8 req-64a7ccb7-9641-4b33-b79a-8e54ce8c65a8 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received unexpected event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 for instance with vm_state active and task_state reboot_started.
Nov 14 22:54:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9e30bcc3-7acf-4967-b76c-62990f6921fb tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.100s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:54 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:54 user nova-compute[76815]: INFO nova.compute.manager [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Terminating instance
Nov 14 22:54:54 user nova-compute[76815]: DEBUG nova.compute.manager [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:54:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-b799710d-f3b1-401f-8c28-dc7e898b0af1 req-47ce0b51-a2b6-4313-ae37-7e5a77b24f83 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received event network-vif-unplugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b799710d-f3b1-401f-8c28-dc7e898b0af1 req-47ce0b51-a2b6-4313-ae37-7e5a77b24f83 service nova] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b799710d-f3b1-401f-8c28-dc7e898b0af1 req-47ce0b51-a2b6-4313-ae37-7e5a77b24f83 service nova] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-b799710d-f3b1-401f-8c28-dc7e898b0af1 req-47ce0b51-a2b6-4313-ae37-7e5a77b24f83 service nova] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-b799710d-f3b1-401f-8c28-dc7e898b0af1 req-47ce0b51-a2b6-4313-ae37-7e5a77b24f83 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] No waiting events found dispatching network-vif-unplugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG nova.compute.manager [req-b799710d-f3b1-401f-8c28-dc7e898b0af1 req-47ce0b51-a2b6-4313-ae37-7e5a77b24f83 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received event network-vif-unplugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:55 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Instance destroyed successfully.
Nov 14 22:54:55 user nova-compute[76815]: DEBUG nova.objects.instance [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lazy-loading 'resources' on Instance uuid ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1444452786',display_name='tempest-SnapshotDataIntegrityTests-server-1444452786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1444452786',id=51,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwV55HmjY+tcxcSX3rd2reTN/UF/Qss1XOW3/MahUllQjnZPeQpCCUDy8/u1imaZrIrMDJtGiAvULbUuqNnxmBJLmyNH6IO+i3/MKemXSYAEXYzvkLINKKHkVGJOnSjPg==',key_name='tempest-keypair-1298659560',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:48:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f86231e39e6405ea7ce2a1e499e2be8',ramdisk_id='',reservation_id='r-jeeh6hsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-489212323',owner_user_name='tempest-SnapshotDataIntegrityTests-489212323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='625d6e10a8c947c1b12d1177c38dbad3',uuid=ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Converting VIF {"id": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "address": "fa:16:3e:40:2f:bb", "network": {"id": "83326788-46d4-4a0c-9859-a413166c4d8a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1373231107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f86231e39e6405ea7ce2a1e499e2be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a8c65d8-76", "ovs_interfaceid": "4a8c65d8-764c-4e40-aefe-3dca6f7c97db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=4a8c65d8-764c-4e40-aefe-3dca6f7c97db,network=Network(83326788-46d4-4a0c-9859-a413166c4d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8c65d8-76') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG os_vif [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=4a8c65d8-764c-4e40-aefe-3dca6f7c97db,network=Network(83326788-46d4-4a0c-9859-a413166c4d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8c65d8-76') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a8c65d8-76, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ba5c43a-3acb-4d18-a308-17838b45041b) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:54:55 user nova-compute[76815]: INFO os_vif [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:2f:bb,bridge_name='br-int',has_traffic_filtering=True,id=4a8c65d8-764c-4e40-aefe-3dca6f7c97db,network=Network(83326788-46d4-4a0c-9859-a413166c4d8a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a8c65d8-76')
Nov 14 22:54:55 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Deleting instance files /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa_del
Nov 14 22:54:55 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Deletion of /opt/stack/data/nova/instances/ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa_del complete
Nov 14 22:54:55 user nova-compute[76815]: INFO nova.compute.manager [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 14 22:54:55 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:54:55 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:54:56 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:54:56 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Took 1.07 seconds to deallocate network for instance.
Nov 14 22:54:56 user nova-compute[76815]: DEBUG nova.compute.manager [req-fa295439-9347-46d7-8779-b85c07504e07 req-37ab409f-1cbc-4815-b471-7797ff25096d service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received event network-vif-deleted-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:54:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:56 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:57 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:54:57 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:54:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:57 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Deleted allocations for instance ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa
Nov 14 22:54:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-9cd12770-e07e-4c51-a1fc-bdfaa308abba tempest-SnapshotDataIntegrityTests-489212323 tempest-SnapshotDataIntegrityTests-489212323-project-member] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.479s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-a0dc514c-7ec0-4d26-90b0-286673ab35bb req-9605eb73-33e8-4bbb-ad86-33b2fce36297 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received event network-vif-plugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:54:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a0dc514c-7ec0-4d26-90b0-286673ab35bb req-9605eb73-33e8-4bbb-ad86-33b2fce36297 service nova] Acquiring lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:54:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a0dc514c-7ec0-4d26-90b0-286673ab35bb req-9605eb73-33e8-4bbb-ad86-33b2fce36297 service nova] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:54:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-a0dc514c-7ec0-4d26-90b0-286673ab35bb req-9605eb73-33e8-4bbb-ad86-33b2fce36297 service nova] Lock "ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:54:57 user nova-compute[76815]: DEBUG nova.compute.manager [req-a0dc514c-7ec0-4d26-90b0-286673ab35bb req-9605eb73-33e8-4bbb-ad86-33b2fce36297 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] No waiting events found dispatching network-vif-plugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:54:57 user nova-compute[76815]: WARNING nova.compute.manager [req-a0dc514c-7ec0-4d26-90b0-286673ab35bb req-9605eb73-33e8-4bbb-ad86-33b2fce36297 service nova] [instance: ebb8bb62-7b6c-4097-80ca-9b5eebc68aaa] Received unexpected event network-vif-plugged-4a8c65d8-764c-4e40-aefe-3dca6f7c97db for instance with vm_state deleted and task_state None.
Nov 14 22:54:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:10 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:55:10 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:55:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8927MB free_disk=24.92281723022461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 22:55:10 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 22:55:11 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 22:55:11 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 22:55:11 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:55:11 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:55:11 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:55:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:55:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:14 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:55:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:18 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:55:22 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_power_states {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 22:55:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:55:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:55:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:55:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:55:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:55:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:51 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:55:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=76815) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:10 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:56:10 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:56:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=9015MB free_disk=24.921524047851562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:56:10 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:56:11 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:56:11 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:56:11 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:56:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:56:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:16 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:56:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:56:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-79f58948-a565-4fc3-97eb-0662d1258aa7 req-d8e28daf-1cbb-4242-aead-4b0d51b12d07 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-changed-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:56:28 user nova-compute[76815]: DEBUG nova.compute.manager [req-79f58948-a565-4fc3-97eb-0662d1258aa7 req-d8e28daf-1cbb-4242-aead-4b0d51b12d07 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing instance network info cache due to event network-changed-d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:56:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79f58948-a565-4fc3-97eb-0662d1258aa7 req-d8e28daf-1cbb-4242-aead-4b0d51b12d07 service nova] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:56:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79f58948-a565-4fc3-97eb-0662d1258aa7 req-d8e28daf-1cbb-4242-aead-4b0d51b12d07 service nova] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:56:28 user nova-compute[76815]: DEBUG nova.network.neutron [req-79f58948-a565-4fc3-97eb-0662d1258aa7 req-d8e28daf-1cbb-4242-aead-4b0d51b12d07 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing network info cache for port d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-79f58948-a565-4fc3-97eb-0662d1258aa7 req-d8e28daf-1cbb-4242-aead-4b0d51b12d07 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updated VIF entry in instance network info cache for port d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-79f58948-a565-4fc3-97eb-0662d1258aa7 req-d8e28daf-1cbb-4242-aead-4b0d51b12d07 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79f58948-a565-4fc3-97eb-0662d1258aa7 req-d8e28daf-1cbb-4242-aead-4b0d51b12d07 service nova] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-9acb924d-136e-4ea6-8bdb-a001a6f50b8e req-c42025c4-4237-4aa6-b7b7-04186dd9f234 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-changed-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-9acb924d-136e-4ea6-8bdb-a001a6f50b8e req-c42025c4-4237-4aa6-b7b7-04186dd9f234 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing instance network info cache due to event network-changed-d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9acb924d-136e-4ea6-8bdb-a001a6f50b8e req-c42025c4-4237-4aa6-b7b7-04186dd9f234 service nova] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9acb924d-136e-4ea6-8bdb-a001a6f50b8e req-c42025c4-4237-4aa6-b7b7-04186dd9f234 service nova] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-9acb924d-136e-4ea6-8bdb-a001a6f50b8e req-c42025c4-4237-4aa6-b7b7-04186dd9f234 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Refreshing network info cache for port d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:56:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:56:29 user nova-compute[76815]: INFO nova.compute.manager [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Detaching volume c255d21c-cec4-4347-8304-62992ed9d90e
Nov 14 22:56:30 user nova-compute[76815]: INFO nova.virt.block_device [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Attempting to driver detach volume c255d21c-cec4-4347-8304-62992ed9d90e from mountpoint /dev/vdb
Nov 14 22:56:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Attempting to detach device vdb from instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 22:56:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:56:30 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:56:30 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:56:30 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:56:30 user nova-compute[76815]:   <serial>c255d21c-cec4-4347-8304-62992ed9d90e</serial>
Nov 14 22:56:30 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:56:30 user nova-compute[76815]: </disk>
Nov 14 22:56:30 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:56:30 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully detached device vdb from instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 from the persistent domain config.
Nov 14 22:56:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 22:56:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 22:56:30 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 22:56:30 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 22:56:30 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 22:56:30 user nova-compute[76815]:   <serial>c255d21c-cec4-4347-8304-62992ed9d90e</serial>
Nov 14 22:56:30 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 22:56:30 user nova-compute[76815]: </disk>
Nov 14 22:56:30 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 22:56:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-9acb924d-136e-4ea6-8bdb-a001a6f50b8e req-c42025c4-4237-4aa6-b7b7-04186dd9f234 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updated VIF entry in instance network info cache for port d689c59f-c00c-453d-a08d-03e94a678283. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:56:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-9acb924d-136e-4ea6-8bdb-a001a6f50b8e req-c42025c4-4237-4aa6-b7b7-04186dd9f234 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:56:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-9acb924d-136e-4ea6-8bdb-a001a6f50b8e req-c42025c4-4237-4aa6-b7b7-04186dd9f234 service nova] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:56:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 22:56:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:41 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:56:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:50 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 is timed out.
Nov 14 22:56:50 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully detached device vdb from instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 from the live domain config.
Nov 14 22:56:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKLSUjWi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 22:56:50 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28811b3-2f2a-4537-9d7c-dd466d26b371]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 22:56:50 user nova-compute[76815]: No targets found.
Nov 14 22:56:50 user nova-compute[76815]: iSNS:
Nov 14 22:56:50 user nova-compute[76815]: No targets found.
Nov 14 22:56:50 user nova-compute[76815]: STATIC:
Nov 14 22:56:50 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e
Nov 14 22:56:50 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 22:56:50 user nova-compute[76815]:                 Iface Name: default
Nov 14 22:56:50 user nova-compute[76815]: FIRMWARE:
Nov 14 22:56:50 user nova-compute[76815]: No targets found.
Nov 14 22:56:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 22:56:50 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 22:56:50 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[03239219-43ef-4655-a23f-7aa1e8f176c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dfccf8-e3e7-4958-a17f-d2748d44fa80]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e (non-flash)
Nov 14 22:56:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e (non-flash)
Nov 14 22:56:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a43ff370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e1ce61-279c-4bd5-a170-12165f4fac8d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0111c9a1-114e-4d7c-a8e4-d041f4d2aa6a]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cca53e-6cec-4154-95d1-ca614214f6a1]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e948730-0af7-4196-86a2-4b86c1c7b635]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c737c7d6-9218-4f73-bc2d-e7d22dd7221a]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fc7472-a634-4f6a-99c1-512ff0f403d8]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e, portal: 172.16.0.220,3260]
Nov 14 22:56:50 user nova-compute[76815]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e, portal: 172.16.0.220,3260] successful.
Nov 14 22:56:50 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c255d21c-cec4-4347-8304-62992ed9d90e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c29452-fc0f-44d9-afcd-dac6472fd8a9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] <== disconnect_volume: return (294ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 22:56:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:56:51 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'flavor' on Instance uuid 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:56:51 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c002901-d97b-4519-b7bd-1bff69815113 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:56:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [{"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-28a08c9f-a6d5-4299-afe3-c43f3c2803c7" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:57:11 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:57:12 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:57:12 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:57:12 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=24.92074203491211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:57:12 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:57:13 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:57:13 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:57:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:57:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:57:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:57:15 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:57:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:17 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:57:17 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:57:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:57:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:57:22 user nova-compute[76815]: INFO nova.compute.manager [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Terminating instance
Nov 14 22:57:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-ce2c1cda-56af-4298-af90-18f348760f2d req-6e335d76-33e6-4ccc-9e1b-cb796666a934 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-unplugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ce2c1cda-56af-4298-af90-18f348760f2d req-6e335d76-33e6-4ccc-9e1b-cb796666a934 service nova] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ce2c1cda-56af-4298-af90-18f348760f2d req-6e335d76-33e6-4ccc-9e1b-cb796666a934 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-ce2c1cda-56af-4298-af90-18f348760f2d req-6e335d76-33e6-4ccc-9e1b-cb796666a934 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-ce2c1cda-56af-4298-af90-18f348760f2d req-6e335d76-33e6-4ccc-9e1b-cb796666a934 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] No waiting events found dispatching network-vif-unplugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG nova.compute.manager [req-ce2c1cda-56af-4298-af90-18f348760f2d req-6e335d76-33e6-4ccc-9e1b-cb796666a934 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-unplugged-d689c59f-c00c-453d-a08d-03e94a678283 for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 22:57:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:23 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Instance destroyed successfully.
Nov 14 22:57:23 user nova-compute[76815]: DEBUG nova.objects.instance [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lazy-loading 'resources' on Instance uuid 28a08c9f-a6d5-4299-afe3-c43f3c2803c7 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-934772048',display_name='tempest-TestMinimumBasicScenario-server-934772048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-934772048',id=52,image_ref='8001aec6-054e-49f5-874b-d4eb3d7c84a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrMS1QcJEoEqAd/TMAOVokkPCBLEOYEi2I433O52XsuDu+b0zi1NVfpzwkEVYscDGVogCCIND4sZKxDv1jVVT2v9tGBxhbfiqT8yadwiHeQKZYLfG4EBhAQfvHI0jiKuQ==',key_name='tempest-TestMinimumBasicScenario-105758653',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:52:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='769ed1e318574e63a3153f1661b887f2',ramdisk_id='',reservation_id='r-4wzy0iav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8001aec6-054e-49f5-874b-d4eb3d7c84a1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-546482846',owner_user_name='tempest-TestMinimumBasicScenario-546482846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:54:44Z,user_data=None,user_id='b8f9992958464143ac94c697f6d23920',uuid=28a08c9f-a6d5-4299-afe3-c43f3c2803c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converting VIF {"id": "d689c59f-c00c-453d-a08d-03e94a678283", "address": "fa:16:3e:92:92:6c", "network": {"id": "9a32183c-4bd7-4165-84e9-67dfb4214cae", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-979266448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "769ed1e318574e63a3153f1661b887f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd689c59f-c0", "ovs_interfaceid": "d689c59f-c00c-453d-a08d-03e94a678283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=d689c59f-c00c-453d-a08d-03e94a678283,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd689c59f-c0') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG os_vif [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=d689c59f-c00c-453d-a08d-03e94a678283,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd689c59f-c0') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd689c59f-c0, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fa15bc4-2ae5-4794-a43a-2b7adc9e0682) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:57:23 user nova-compute[76815]: INFO os_vif [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:92:6c,bridge_name='br-int',has_traffic_filtering=True,id=d689c59f-c00c-453d-a08d-03e94a678283,network=Network(9a32183c-4bd7-4165-84e9-67dfb4214cae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd689c59f-c0')
Nov 14 22:57:23 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Deleting instance files /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7_del
Nov 14 22:57:23 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Deletion of /opt/stack/data/nova/instances/28a08c9f-a6d5-4299-afe3-c43f3c2803c7_del complete
Nov 14 22:57:23 user nova-compute[76815]: INFO nova.compute.manager [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 14 22:57:23 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:57:23 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Took 0.44 seconds to deallocate network for instance.
Nov 14 22:57:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:57:23 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:57:23 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Deleted allocations for instance 28a08c9f-a6d5-4299-afe3-c43f3c2803c7
Nov 14 22:57:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-fa72bc22-fc32-4473-aecc-2505424e89c2 tempest-TestMinimumBasicScenario-546482846 tempest-TestMinimumBasicScenario-546482846-project-member] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.566s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:57:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-04012ed7-9f1e-496c-8bf8-ff9a72e52e67 req-cd58eee0-34d5-4488-9142-ffcae5357716 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:57:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-04012ed7-9f1e-496c-8bf8-ff9a72e52e67 req-cd58eee0-34d5-4488-9142-ffcae5357716 service nova] Acquiring lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:57:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-04012ed7-9f1e-496c-8bf8-ff9a72e52e67 req-cd58eee0-34d5-4488-9142-ffcae5357716 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:57:24 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-04012ed7-9f1e-496c-8bf8-ff9a72e52e67 req-cd58eee0-34d5-4488-9142-ffcae5357716 service nova] Lock "28a08c9f-a6d5-4299-afe3-c43f3c2803c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:57:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-04012ed7-9f1e-496c-8bf8-ff9a72e52e67 req-cd58eee0-34d5-4488-9142-ffcae5357716 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] No waiting events found dispatching network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:57:24 user nova-compute[76815]: WARNING nova.compute.manager [req-04012ed7-9f1e-496c-8bf8-ff9a72e52e67 req-cd58eee0-34d5-4488-9142-ffcae5357716 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received unexpected event network-vif-plugged-d689c59f-c00c-453d-a08d-03e94a678283 for instance with vm_state deleted and task_state None.
Nov 14 22:57:24 user nova-compute[76815]: DEBUG nova.compute.manager [req-04012ed7-9f1e-496c-8bf8-ff9a72e52e67 req-cd58eee0-34d5-4488-9142-ffcae5357716 service nova] [instance: 28a08c9f-a6d5-4299-afe3-c43f3c2803c7] Received event network-vif-deleted-d689c59f-c00c-453d-a08d-03e94a678283 {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:57:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:57:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:57:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:57:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:57:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:58:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:58:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:58:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:58:12 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:58:12 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:58:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:58:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=9141MB free_disk=24.948081970214844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:58:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:58:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:17 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:58:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:58:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:58:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:58:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:58:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:58:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:58:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:58:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:58:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:58:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:58:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 22:58:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:58:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 22:58:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:08 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:59:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:59:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:59:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=24.98291778564453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 22:59:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:59:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:14 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 22:59:14 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 22:59:14 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 22:59:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:17 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:17 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 22:59:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:59:26 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:59:26 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Starting instance... {{(pid=76815) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=76815) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 22:59:27 user nova-compute[76815]: INFO nova.compute.claims [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Claim successful on node user
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Start building networks asynchronously for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Allocating IP information in the background. {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] allocate_for_instance() {{(pid=76815) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 22:59:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Start building block device mappings for instance. {{(pid=76815) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Start spawning the instance on the hypervisor. {{(pid=76815) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Creating instance directory {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 22:59:27 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Creating image(s)
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "/opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "/opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "/opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG nova.policy [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95922dcd8c254da18864a1d0e498c1eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895e509457844d639d43c72d2adbbc51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=76815) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "671dcf04805df5f968a361885670012072ed1b4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:59:27 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk 1073741824 {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b,backing_fmt=raw /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk 1073741824" returned: 0 in 0.059s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "671dcf04805df5f968a361885670012072ed1b4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/671dcf04805df5f968a361885670012072ed1b4b --force-share --output=json" returned: 0 in 0.188s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk. size=1073741824 {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG nova.virt.disk.api [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Cannot resize image /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk to a smaller size. {{(pid=76815) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Created local disks {{(pid=76815) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Ensure instance console log exists: /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/console.log {{(pid=76815) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Successfully created port: 7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 22:59:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Successfully updated port: 7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquired lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Building network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-551a9a1d-fd6b-4202-844c-28282fe441ca req-dae86367-20ff-4c30-8cbd-3020b0130bdd service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received event network-changed-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.compute.manager [req-551a9a1d-fd6b-4202-844c-28282fe441ca req-dae86367-20ff-4c30-8cbd-3020b0130bdd service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Refreshing instance network info cache due to event network-changed-7dc78aba-9b2e-493b-8062-0791d3df96df. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-551a9a1d-fd6b-4202-844c-28282fe441ca req-dae86367-20ff-4c30-8cbd-3020b0130bdd service nova] Acquiring lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Instance cache missing network info. {{(pid=76815) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.network.neutron [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Releasing lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Instance network_info: |[{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=76815) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-551a9a1d-fd6b-4202-844c-28282fe441ca req-dae86367-20ff-4c30-8cbd-3020b0130bdd service nova] Acquired lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.network.neutron [req-551a9a1d-fd6b-4202-844c-28282fe441ca req-dae86367-20ff-4c30-8cbd-3020b0130bdd service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Refreshing network info cache for port 7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Start _get_guest_xml network_info=[{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'disk_bus': 'virtio', 'encryption_format': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'size': 0, 'encrypted': False, 'boot_index': 0, 'image_id': '17f0b7df-7e07-48b3-bb67-6524172efa0a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 22:59:29 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:59:29 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] CPU controller missing on host. {{(pid=76815) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.host [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] CPU controller found on host. {{(pid=76815) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=76815) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T22:03:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T22:03:52Z,direct_url=<?>,disk_format='qcow2',id=17f0b7df-7e07-48b3-bb67-6524172efa0a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='04d44a937240472985dfffe4a6ab1306',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T22:03:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Flavor limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Image limits 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Flavor pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Image pref 0:0:0 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=76815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Got 1 possible topologies {{(pid=76815) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.hardware [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=76815) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1393322600',display_name='tempest-SnapshotDataIntegrityTests-server-1393322600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1393322600',id=53,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXnNzdvMOhTakylL7LhgczsDN5RpakKsd2zVWDv/XqFrQDuly1sXrSv2KSxjlwgX0JGJjjmDL8qD9+jMIwkBoJJdUyn10ftPPCmE58wDS3D0Nrbh9OpVu0syNImsLgCcA==',key_name='tempest-keypair-1150691899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='895e509457844d639d43c72d2adbbc51',ramdisk_id='',reservation_id='r-h7kgrx04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1549100178',owner_user_name='tempest-SnapshotDataIntegrityTests-1549100178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95922dcd8c254da18864a1d0e498c1eb',uuid=230541ab-0012-44bc-84cf-2d975d511a39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=76815) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Converting VIF {"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c3:60,bridge_name='br-int',has_traffic_filtering=True,id=7dc78aba-9b2e-493b-8062-0791d3df96df,network=Network(0ac2ca09-e81e-4ff3-9145-a4ea4fc04276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc78aba-9b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'pci_devices' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] End _get_guest_xml xml=<domain type="kvm">
Nov 14 22:59:29 user nova-compute[76815]:   <uuid>230541ab-0012-44bc-84cf-2d975d511a39</uuid>
Nov 14 22:59:29 user nova-compute[76815]:   <name>instance-00000035</name>
Nov 14 22:59:29 user nova-compute[76815]:   <memory>524288</memory>
Nov 14 22:59:29 user nova-compute[76815]:   <vcpu>1</vcpu>
Nov 14 22:59:29 user nova-compute[76815]:   <metadata>
Nov 14 22:59:29 user nova-compute[76815]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 22:59:29 user nova-compute[76815]:       <nova:package version="0.0.0"/>
Nov 14 22:59:29 user nova-compute[76815]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1393322600</nova:name>
Nov 14 22:59:29 user nova-compute[76815]:       <nova:creationTime>2023-11-14 22:59:29</nova:creationTime>
Nov 14 22:59:29 user nova-compute[76815]:       <nova:flavor name="m1.tiny">
Nov 14 22:59:29 user nova-compute[76815]:         <nova:memory>512</nova:memory>
Nov 14 22:59:29 user nova-compute[76815]:         <nova:disk>1</nova:disk>
Nov 14 22:59:29 user nova-compute[76815]:         <nova:swap>0</nova:swap>
Nov 14 22:59:29 user nova-compute[76815]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 22:59:29 user nova-compute[76815]:         <nova:vcpus>1</nova:vcpus>
Nov 14 22:59:29 user nova-compute[76815]:       </nova:flavor>
Nov 14 22:59:29 user nova-compute[76815]:       <nova:owner>
Nov 14 22:59:29 user nova-compute[76815]:         <nova:user uuid="95922dcd8c254da18864a1d0e498c1eb">tempest-SnapshotDataIntegrityTests-1549100178-project-member</nova:user>
Nov 14 22:59:29 user nova-compute[76815]:         <nova:project uuid="895e509457844d639d43c72d2adbbc51">tempest-SnapshotDataIntegrityTests-1549100178</nova:project>
Nov 14 22:59:29 user nova-compute[76815]:       </nova:owner>
Nov 14 22:59:29 user nova-compute[76815]:       <nova:root type="image" uuid="17f0b7df-7e07-48b3-bb67-6524172efa0a"/>
Nov 14 22:59:29 user nova-compute[76815]:       <nova:ports>
Nov 14 22:59:29 user nova-compute[76815]:         <nova:port uuid="7dc78aba-9b2e-493b-8062-0791d3df96df">
Nov 14 22:59:29 user nova-compute[76815]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 22:59:29 user nova-compute[76815]:         </nova:port>
Nov 14 22:59:29 user nova-compute[76815]:       </nova:ports>
Nov 14 22:59:29 user nova-compute[76815]:     </nova:instance>
Nov 14 22:59:29 user nova-compute[76815]:   </metadata>
Nov 14 22:59:29 user nova-compute[76815]:   <sysinfo type="smbios">
Nov 14 22:59:29 user nova-compute[76815]:     <system>
Nov 14 22:59:29 user nova-compute[76815]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 22:59:29 user nova-compute[76815]:       <entry name="product">OpenStack Nova</entry>
Nov 14 22:59:29 user nova-compute[76815]:       <entry name="version">0.0.0</entry>
Nov 14 22:59:29 user nova-compute[76815]:       <entry name="serial">230541ab-0012-44bc-84cf-2d975d511a39</entry>
Nov 14 22:59:29 user nova-compute[76815]:       <entry name="uuid">230541ab-0012-44bc-84cf-2d975d511a39</entry>
Nov 14 22:59:29 user nova-compute[76815]:       <entry name="family">Virtual Machine</entry>
Nov 14 22:59:29 user nova-compute[76815]:     </system>
Nov 14 22:59:29 user nova-compute[76815]:   </sysinfo>
Nov 14 22:59:29 user nova-compute[76815]:   <os>
Nov 14 22:59:29 user nova-compute[76815]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 22:59:29 user nova-compute[76815]:     <boot dev="hd"/>
Nov 14 22:59:29 user nova-compute[76815]:     <smbios mode="sysinfo"/>
Nov 14 22:59:29 user nova-compute[76815]:   </os>
Nov 14 22:59:29 user nova-compute[76815]:   <features>
Nov 14 22:59:29 user nova-compute[76815]:     <acpi/>
Nov 14 22:59:29 user nova-compute[76815]:     <apic/>
Nov 14 22:59:29 user nova-compute[76815]:     <vmcoreinfo/>
Nov 14 22:59:29 user nova-compute[76815]:   </features>
Nov 14 22:59:29 user nova-compute[76815]:   <clock offset="utc">
Nov 14 22:59:29 user nova-compute[76815]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 22:59:29 user nova-compute[76815]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 22:59:29 user nova-compute[76815]:     <timer name="hpet" present="no"/>
Nov 14 22:59:29 user nova-compute[76815]:   </clock>
Nov 14 22:59:29 user nova-compute[76815]:   <cpu mode="custom" match="exact">
Nov 14 22:59:29 user nova-compute[76815]:     <model>Nehalem</model>
Nov 14 22:59:29 user nova-compute[76815]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 22:59:29 user nova-compute[76815]:   </cpu>
Nov 14 22:59:29 user nova-compute[76815]:   <devices>
Nov 14 22:59:29 user nova-compute[76815]:     <disk type="file" device="disk">
Nov 14 22:59:29 user nova-compute[76815]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 22:59:29 user nova-compute[76815]:       <source file="/opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk"/>
Nov 14 22:59:29 user nova-compute[76815]:       <target dev="vda" bus="virtio"/>
Nov 14 22:59:29 user nova-compute[76815]:     </disk>
Nov 14 22:59:29 user nova-compute[76815]:     <interface type="ethernet">
Nov 14 22:59:29 user nova-compute[76815]:       <mac address="fa:16:3e:6a:c3:60"/>
Nov 14 22:59:29 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:59:29 user nova-compute[76815]:       <mtu size="1442"/>
Nov 14 22:59:29 user nova-compute[76815]:       <target dev="tap7dc78aba-9b"/>
Nov 14 22:59:29 user nova-compute[76815]:     </interface>
Nov 14 22:59:29 user nova-compute[76815]:     <serial type="pty">
Nov 14 22:59:29 user nova-compute[76815]:       <log file="/opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/console.log" append="off"/>
Nov 14 22:59:29 user nova-compute[76815]:     </serial>
Nov 14 22:59:29 user nova-compute[76815]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 22:59:29 user nova-compute[76815]:     <video>
Nov 14 22:59:29 user nova-compute[76815]:       <model type="virtio"/>
Nov 14 22:59:29 user nova-compute[76815]:     </video>
Nov 14 22:59:29 user nova-compute[76815]:     <rng model="virtio">
Nov 14 22:59:29 user nova-compute[76815]:       <backend model="random">/dev/urandom</backend>
Nov 14 22:59:29 user nova-compute[76815]:     </rng>
Nov 14 22:59:29 user nova-compute[76815]:     <controller type="usb" index="0" model="none"/>
Nov 14 22:59:29 user nova-compute[76815]:     <memballoon model="virtio">
Nov 14 22:59:29 user nova-compute[76815]:       <stats period="10"/>
Nov 14 22:59:29 user nova-compute[76815]:     </memballoon>
Nov 14 22:59:29 user nova-compute[76815]:   </devices>
Nov 14 22:59:29 user nova-compute[76815]: </domain>
Nov 14 22:59:29 user nova-compute[76815]:  {{(pid=76815) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1393322600',display_name='tempest-SnapshotDataIntegrityTests-server-1393322600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1393322600',id=53,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXnNzdvMOhTakylL7LhgczsDN5RpakKsd2zVWDv/XqFrQDuly1sXrSv2KSxjlwgX0JGJjjmDL8qD9+jMIwkBoJJdUyn10ftPPCmE58wDS3D0Nrbh9OpVu0syNImsLgCcA==',key_name='tempest-keypair-1150691899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='895e509457844d639d43c72d2adbbc51',ramdisk_id='',reservation_id='r-h7kgrx04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1549100178',owner_user_name='tempest-SnapshotDataIntegrityTests-1549100178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T22:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95922dcd8c254da18864a1d0e498c1eb',uuid=230541ab-0012-44bc-84cf-2d975d511a39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Converting VIF {"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c3:60,bridge_name='br-int',has_traffic_filtering=True,id=7dc78aba-9b2e-493b-8062-0791d3df96df,network=Network(0ac2ca09-e81e-4ff3-9145-a4ea4fc04276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc78aba-9b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG os_vif [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c3:60,bridge_name='br-int',has_traffic_filtering=True,id=7dc78aba-9b2e-493b-8062-0791d3df96df,network=Network(0ac2ca09-e81e-4ff3-9145-a4ea4fc04276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc78aba-9b') {{(pid=76815) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb7dd2d3-c771-5bb6-ae57-1d13ef777b47', '_type': 'linux-noop'}}, row=False) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dc78aba-9b, may_exist=True, interface_attrs={}) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dc78aba-9b, col_values=(('qos', UUID('50ae4f1d-cf8a-4409-9760-a8220fdbdf2f')),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dc78aba-9b, col_values=(('external_ids', {'iface-id': '7dc78aba-9b2e-493b-8062-0791d3df96df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:c3:60', 'vm-uuid': '230541ab-0012-44bc-84cf-2d975d511a39'}),), if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 22:59:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:29 user nova-compute[76815]: INFO os_vif [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c3:60,bridge_name='br-int',has_traffic_filtering=True,id=7dc78aba-9b2e-493b-8062-0791d3df96df,network=Network(0ac2ca09-e81e-4ff3-9145-a4ea4fc04276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc78aba-9b')
Nov 14 22:59:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 22:59:30 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No VIF found with MAC fa:16:3e:6a:c3:60, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 22:59:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-551a9a1d-fd6b-4202-844c-28282fe441ca req-dae86367-20ff-4c30-8cbd-3020b0130bdd service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updated VIF entry in instance network info cache for port 7dc78aba-9b2e-493b-8062-0791d3df96df. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 22:59:30 user nova-compute[76815]: DEBUG nova.network.neutron [req-551a9a1d-fd6b-4202-844c-28282fe441ca req-dae86367-20ff-4c30-8cbd-3020b0130bdd service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 22:59:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-551a9a1d-fd6b-4202-844c-28282fe441ca req-dae86367-20ff-4c30-8cbd-3020b0130bdd service nova] Releasing lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 22:59:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:31 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-cb06f2fe-711f-4e7b-800c-e0cb623c84e9 req-d45ec446-4b50-4a32-a172-6f91c45b9099 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received event network-vif-plugged-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:59:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cb06f2fe-711f-4e7b-800c-e0cb623c84e9 req-d45ec446-4b50-4a32-a172-6f91c45b9099 service nova] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:59:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cb06f2fe-711f-4e7b-800c-e0cb623c84e9 req-d45ec446-4b50-4a32-a172-6f91c45b9099 service nova] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:59:31 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-cb06f2fe-711f-4e7b-800c-e0cb623c84e9 req-d45ec446-4b50-4a32-a172-6f91c45b9099 service nova] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:59:31 user nova-compute[76815]: DEBUG nova.compute.manager [req-cb06f2fe-711f-4e7b-800c-e0cb623c84e9 req-d45ec446-4b50-4a32-a172-6f91c45b9099 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] No waiting events found dispatching network-vif-plugged-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:59:31 user nova-compute[76815]: WARNING nova.compute.manager [req-cb06f2fe-711f-4e7b-800c-e0cb623c84e9 req-d45ec446-4b50-4a32-a172-6f91c45b9099 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received unexpected event network-vif-plugged-7dc78aba-9b2e-493b-8062-0791d3df96df for instance with vm_state building and task_state spawning.
Nov 14 22:59:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e10d2ace-cdc7-473d-9324-c2a7ed41fea7 req-52696620-efaf-4219-9402-c72e6b4f4f04 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received event network-vif-plugged-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e10d2ace-cdc7-473d-9324-c2a7ed41fea7 req-52696620-efaf-4219-9402-c72e6b4f4f04 service nova] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e10d2ace-cdc7-473d-9324-c2a7ed41fea7 req-52696620-efaf-4219-9402-c72e6b4f4f04 service nova] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-e10d2ace-cdc7-473d-9324-c2a7ed41fea7 req-52696620-efaf-4219-9402-c72e6b4f4f04 service nova] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.compute.manager [req-e10d2ace-cdc7-473d-9324-c2a7ed41fea7 req-52696620-efaf-4219-9402-c72e6b4f4f04 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] No waiting events found dispatching network-vif-plugged-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 22:59:33 user nova-compute[76815]: WARNING nova.compute.manager [req-e10d2ace-cdc7-473d-9324-c2a7ed41fea7 req-52696620-efaf-4219-9402-c72e6b4f4f04 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received unexpected event network-vif-plugged-7dc78aba-9b2e-493b-8062-0791d3df96df for instance with vm_state building and task_state spawning.
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Instance event wait completed in 0 seconds for  {{(pid=76815) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Guest created on hypervisor {{(pid=76815) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 22:59:33 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Instance spawned successfully.
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Found default for hw_cdrom_bus of ide {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Found default for hw_disk_bus of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Found default for hw_input_bus of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Found default for hw_pointer_model of None {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Found default for hw_video_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Found default for hw_vif_model of virtio {{(pid=76815) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 22:59:33 user nova-compute[76815]: INFO nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 14 22:59:33 user nova-compute[76815]: DEBUG nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Checking state {{(pid=76815) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 22:59:33 user nova-compute[76815]: INFO nova.compute.manager [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Took 6.93 seconds to build instance.
Nov 14 22:59:33 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4fdff3c5-bf35-4aec-8748-7c4d158189b9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.073s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 22:59:34 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 22:59:34 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 22:59:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:46 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 22:59:46 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 22:59:48 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:58 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 22:59:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:03 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:00:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:00:13 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:00:13 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=24.941905975341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:00:13 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 230541ab-0012-44bc-84cf-2d975d511a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:14 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:00:15 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:00:19 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:24 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:29 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:00:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:29 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:00:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:34 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:00:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:39 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:44 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:47 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:00:49 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:00:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:54 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:00:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:00:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:00:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:00:59 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:01:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:01:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:01:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:01:04 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:01:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:01:09 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:01:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:01:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:01:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:01:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.94135284423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 230541ab-0012-44bc-84cf-2d975d511a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:01:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:01:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:01:15 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:01:15 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:01:15 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:01:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:01:16 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:01:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-fa0a6945-8baa-48d3-9b58-8a350504aa84 req-b96b21bc-bdcb-4c33-9540-1316430774f0 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received event network-changed-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:01:17 user nova-compute[76815]: DEBUG nova.compute.manager [req-fa0a6945-8baa-48d3-9b58-8a350504aa84 req-b96b21bc-bdcb-4c33-9540-1316430774f0 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Refreshing instance network info cache due to event network-changed-7dc78aba-9b2e-493b-8062-0791d3df96df. {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 23:01:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fa0a6945-8baa-48d3-9b58-8a350504aa84 req-b96b21bc-bdcb-4c33-9540-1316430774f0 service nova] Acquiring lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:01:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fa0a6945-8baa-48d3-9b58-8a350504aa84 req-b96b21bc-bdcb-4c33-9540-1316430774f0 service nova] Acquired lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:01:17 user nova-compute[76815]: DEBUG nova.network.neutron [req-fa0a6945-8baa-48d3-9b58-8a350504aa84 req-b96b21bc-bdcb-4c33-9540-1316430774f0 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Refreshing network info cache for port 7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 23:01:18 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:18 user nova-compute[76815]: DEBUG nova.network.neutron [req-fa0a6945-8baa-48d3-9b58-8a350504aa84 req-b96b21bc-bdcb-4c33-9540-1316430774f0 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updated VIF entry in instance network info cache for port 7dc78aba-9b2e-493b-8062-0791d3df96df. {{(pid=76815) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 23:01:18 user nova-compute[76815]: DEBUG nova.network.neutron [req-fa0a6945-8baa-48d3-9b58-8a350504aa84 req-b96b21bc-bdcb-4c33-9540-1316430774f0 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:01:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-fa0a6945-8baa-48d3-9b58-8a350504aa84 req-b96b21bc-bdcb-4c33-9540-1316430774f0 service nova] Releasing lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:01:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:01:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:01:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:01:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG nova.objects.instance [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:01:21 user nova-compute[76815]: INFO nova.compute.manager [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attaching volume e6f542e6-1a28-4c38-b5ff-721631be70b7 to /dev/vdb
Nov 14 23:01:21 user nova-compute[76815]: DEBUG os_brick.utils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c16b6d-bc52-4f1e-b118-2d4dd502c7c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a966ed4-2eaa-4e40-a69c-a40e755fc9b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c8c68a-cb79-4f98-b412-885ab8b7ac94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7bdb0b-b129-47a1-82b7-da12b7c233fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:01:21 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:01:21 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba54a258-cd58-4db9-ab6f-dcedd82630bb]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG os_brick.utils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:01:21 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating existing volume attachment record: 845f61f1-10a6-4f8f-a024-c3e89f592c58 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:01:23 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:01:25 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:01:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkgRZbdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:01:25 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:01:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:01:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:01:25 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:01:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:01:25 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:01:25 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:01:25 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b14b3e8-6477-4a0e-bb77-0a7efa71660a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:01:26 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3239d745-e5b8-47ba-a075-e215869f656a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7] added
Nov 14 23:01:26 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6987cd7d-e59c-40cb-a4a6-0377b5b13c05]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3335ced-03b3-4162-ba71-7e8e8b7442bd]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FkgRZbdl {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FkgRZbdl" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[96622fed-7831-426a-9bc3-1228ae5813ea]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FkgRZbdl'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede3fee-8f2f-4353-95bc-9a627a05de22]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7479d05-9d49-4580-a874-817f02059618]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:01:26 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:01:26 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:01:26 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 23:01:26 user nova-compute[76815]: 
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[f179d0fd-1062-4ded-9a7e-4b49a3fd5ab5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7, portal: 172.16.0.220,3260]
Nov 14 23:01:26 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7, portal: 172.16.0.220,3260] successful.
Nov 14 23:01:26 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96e57bd-c55b-4ddf-a507-88eb8b666ab5]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[17623f6b-b78d-43a8-b54f-c917336800c9]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 (non-flash)
Nov 14 23:01:26 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 (non-flash)
Nov 14 23:01:26 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c08e83-6e06-4cab-a923-705288882c73]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:01:26 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkgRZbdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:01:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:01:27 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26135356164663565', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:01:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135356164663565', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:01:27 user nova-compute[76815]: DEBUG nova.objects.instance [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:01:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:01:27 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:01:27 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:01:27 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:01:27 user nova-compute[76815]:   <serial>e6f542e6-1a28-4c38-b5ff-721631be70b7</serial>
Nov 14 23:01:27 user nova-compute[76815]: </disk>
Nov 14 23:01:27 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:01:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:01:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:01:27 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No VIF found with MAC fa:16:3e:6a:c3:60, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:01:27 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8aade129-f260-4409-bec8-bef60dfe2680 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.386s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:01:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:31 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:01:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:01:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:01:36 user nova-compute[76815]: INFO nova.compute.manager [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Detaching volume e6f542e6-1a28-4c38-b5ff-721631be70b7
Nov 14 23:01:36 user nova-compute[76815]: INFO nova.virt.block_device [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attempting to driver detach volume e6f542e6-1a28-4c38-b5ff-721631be70b7 from mountpoint /dev/vdb
Nov 14 23:01:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Attempting to detach device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:01:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:01:36 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:01:36 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:01:36 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:01:36 user nova-compute[76815]:   <serial>e6f542e6-1a28-4c38-b5ff-721631be70b7</serial>
Nov 14 23:01:36 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:01:36 user nova-compute[76815]: </disk>
Nov 14 23:01:36 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:01:36 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully detached device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the persistent domain config.
Nov 14 23:01:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:01:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:01:36 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:01:36 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:01:36 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:01:36 user nova-compute[76815]:   <serial>e6f542e6-1a28-4c38-b5ff-721631be70b7</serial>
Nov 14 23:01:36 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:01:36 user nova-compute[76815]: </disk>
Nov 14 23:01:36 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:01:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:01:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:01:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:01:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:01:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:01:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:01:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:53 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:01:56 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 230541ab-0012-44bc-84cf-2d975d511a39 is timed out.
Nov 14 23:01:56 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully detached device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the live domain config.
Nov 14 23:01:56 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkgRZbdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:01:56 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed5c178-1d72-46ec-af09-0333c0c4726c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:01:56 user nova-compute[76815]: No targets found.
Nov 14 23:01:56 user nova-compute[76815]: iSNS:
Nov 14 23:01:56 user nova-compute[76815]: No targets found.
Nov 14 23:01:56 user nova-compute[76815]: STATIC:
Nov 14 23:01:56 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7
Nov 14 23:01:56 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:01:56 user nova-compute[76815]:                 Iface Name: default
Nov 14 23:01:56 user nova-compute[76815]: FIRMWARE:
Nov 14 23:01:56 user nova-compute[76815]: No targets found.
Nov 14 23:01:56 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:01:56 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:01:56 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[214e31d0-a415-46b3-9bc3-7adee3ba0521]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc4cc04-6e79-415e-b1e3-a7e6b0690623]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 (non-flash)
Nov 14 23:01:56 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 (non-flash)
Nov 14 23:01:56 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74c8598a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f515ed-76ac-4cbd-944c-b8e7f44e2e68]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5125d11d-481d-4136-98a3-3cd696a04b88]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e798204f-dbda-48be-afb1-0dec28e5c5b9]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ddd4f8-d425-404c-9de9-0391b781e21e]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da81f2f-efc0-4074-9aec-fee453316812]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[01199cc0-cd57-4bd2-a455-d740efda68f7]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7, portal: 172.16.0.220,3260]
Nov 14 23:01:56 user nova-compute[76815]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7, portal: 172.16.0.220,3260] successful.
Nov 14 23:01:56 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:56 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:01:57 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6f542e6-1a28-4c38-b5ff-721631be70b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:01:57 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[629ab6cb-117c-48a1-a764-912b7013e840]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:01:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:01:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:01:57 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== disconnect_volume: return (267ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:01:57 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:01:57 user nova-compute[76815]: DEBUG nova.objects.instance [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:01:57 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-1568dedc-1043-491e-a2e8-d45ce1936748 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.568s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:02:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:02:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:02:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:02:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=24.940017700195312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:02:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:02:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:02:15 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 230541ab-0012-44bc-84cf-2d975d511a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:02:15 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:02:15 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:02:15 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:02:15 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:02:15 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:02:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:02:17 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:02:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:02:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:02:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:02:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:21 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:22 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:22 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:02:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG nova.objects.instance [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:02:28 user nova-compute[76815]: INFO nova.compute.manager [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attaching volume 2eed288b-705e-4620-b827-6688ff24df10 to /dev/vdb
Nov 14 23:02:28 user nova-compute[76815]: DEBUG os_brick.utils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd6e918-1803-4040-9a0e-fe0cde2ff39b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b859b-8725-4467-9d6e-68dcd2b46b04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21e0200-a8d4-4854-b935-953f655c5cc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7f8efd-314a-48f4-950b-9c39756a251b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:02:28 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:02:28 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[378fbbba-aad9-42d6-8a6b-ce5274fbdd8f]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG os_brick.utils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:02:28 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating existing volume attachment record: dbf779a3-97b4-402f-b424-843fa99f6733 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:02:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:31 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUwFxbJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:02:33 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:02:33 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:02:33 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bd52d9-2fdb-4a11-aeed-6751c2c862b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:02:33 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3791b9-b781-48a7-967d-bd99778e462b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10] added
Nov 14 23:02:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a67e0c-9924-4461-8294-105b206c7764]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a2daa5-2339-4507-93a0-eb944624a796]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUwFxbJi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUwFxbJi" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f90d7-c037-4363-b501-0477511105ff]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rUwFxbJi'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d7aa62-09f6-492b-bfca-c6932a70361f]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ffb666-d404-4214-a73c-e0c4fea6ca15]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:02:33 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:02:33 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:02:33 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 23:02:33 user nova-compute[76815]: 
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c35ba6-aa10-4559-a6e4-f75b0630cd8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10, portal: 172.16.0.220,3260]
Nov 14 23:02:33 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10, portal: 172.16.0.220,3260] successful.
Nov 14 23:02:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aa804e-f005-4a16-853f-0d05ade0b3cb]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b68e41-20e3-4dcb-b902-a8cdfc59eb09]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 (non-flash)
Nov 14 23:02:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 (non-flash)
Nov 14 23:02:33 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ba693-15a2-4f71-b2aa-3f2cc2278b8e]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:33 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUwFxbJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23135373561306532', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135373561306532', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG nova.objects.instance [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:02:34 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:02:34 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:02:34 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:02:34 user nova-compute[76815]:   <serial>2eed288b-705e-4620-b827-6688ff24df10</serial>
Nov 14 23:02:34 user nova-compute[76815]: </disk>
Nov 14 23:02:34 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No VIF found with MAC fa:16:3e:6a:c3:60, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:02:34 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-826726d5-b43e-4b3a-bc11-8db4ee0136e0 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.484s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:02:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:02:37 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:02:37 user nova-compute[76815]: INFO nova.compute.manager [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Detaching volume 2eed288b-705e-4620-b827-6688ff24df10
Nov 14 23:02:37 user nova-compute[76815]: INFO nova.virt.block_device [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attempting to driver detach volume 2eed288b-705e-4620-b827-6688ff24df10 from mountpoint /dev/vdb
Nov 14 23:02:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Attempting to detach device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:02:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:02:37 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:02:37 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:02:37 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:02:37 user nova-compute[76815]:   <serial>2eed288b-705e-4620-b827-6688ff24df10</serial>
Nov 14 23:02:37 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:02:37 user nova-compute[76815]: </disk>
Nov 14 23:02:37 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:02:37 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully detached device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the persistent domain config.
Nov 14 23:02:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:02:37 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:02:37 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:02:37 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:02:37 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:02:37 user nova-compute[76815]:   <serial>2eed288b-705e-4620-b827-6688ff24df10</serial>
Nov 14 23:02:37 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:02:37 user nova-compute[76815]: </disk>
Nov 14 23:02:37 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:02:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:02:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:02:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:52 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:02:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:02:58 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 230541ab-0012-44bc-84cf-2d975d511a39 is timed out.
Nov 14 23:02:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully detached device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the live domain config.
Nov 14 23:02:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUwFxbJi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:02:58 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c978ed5b-f134-44c2-9abf-ea57155cd38f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:02:58 user nova-compute[76815]: No targets found.
Nov 14 23:02:58 user nova-compute[76815]: iSNS:
Nov 14 23:02:58 user nova-compute[76815]: No targets found.
Nov 14 23:02:58 user nova-compute[76815]: STATIC:
Nov 14 23:02:58 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10
Nov 14 23:02:58 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:02:58 user nova-compute[76815]:                 Iface Name: default
Nov 14 23:02:58 user nova-compute[76815]: FIRMWARE:
Nov 14 23:02:58 user nova-compute[76815]: No targets found.
Nov 14 23:02:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:02:58 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:02:58 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7000c1d7-95f1-4879-a12f-cae3ce5f927d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d55a129-9eea-4918-bf4c-de7ff7498ea1]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 (non-flash)
Nov 14 23:02:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 (non-flash)
Nov 14 23:02:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a43fe710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7eff3e-6297-4b85-9524-b584925a9843]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc030d4-6e10-4225-90a6-37ac132a8d91]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e43dc6-fdfe-4a1d-91c0-25d30a170102]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb28dbe5-892e-428d-b5f0-927aa3a3c185]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43eec1b-e433-4f6a-8c71-4ee62e968a5b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce40025-91d3-401e-b0fe-b5762ebc6521]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10, portal: 172.16.0.220,3260]
Nov 14 23:02:58 user nova-compute[76815]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10, portal: 172.16.0.220,3260] successful.
Nov 14 23:02:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eed288b-705e-4620-b827-6688ff24df10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aec707-7578-43dc-89f3-78be19e37f52]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== disconnect_volume: return (298ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:02:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:02:59 user nova-compute[76815]: DEBUG nova.objects.instance [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:02:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-8286c072-96f8-4a09-b1ac-ff6a3cb2f27c tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:03:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:03:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:03:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:03:14 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:03:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=24.939075469970703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 230541ab-0012-44bc-84cf-2d975d511a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:03:14 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:03:18 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:03:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:03:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:22 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:03:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:03:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG nova.objects.instance [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:03:29 user nova-compute[76815]: INFO nova.compute.manager [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attaching volume 14c59301-3763-4f6e-8cdd-95a496011a41 to /dev/vdb
Nov 14 23:03:29 user nova-compute[76815]: DEBUG os_brick.utils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5f443c-cc26-40bb-b651-b8ea144dfe0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8628d754-6238-463a-ad57-02009a8d302c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe30299-02de-4c03-9fd0-31e8d1e3f457]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f80bf-dd99-457a-a766-866f276769e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:29 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:03:30 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:03:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1997c3e-1c18-496d-9406-acba60f37956]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG os_brick.utils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating existing volume attachment record: 31216e3a-b63d-40e0-91ae-2a4a9807396e {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:31 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:03:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIYxjTXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:03:34 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:03:34 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:03:34 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09049c5-2f02-4271-9577-4f9f4649eaee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:03:34 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ca494f-9bbe-47a0-bddc-4d58182d7c81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41] added
Nov 14 23:03:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ec0bc8-7597-482c-9d69-75ea37ddb8ac]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f806da-4928-4dda-810a-f8edc214e7ca]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIYxjTXC {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIYxjTXC" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3132b7-aae0-46c9-95ca-295f64eea1cd]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dIYxjTXC'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[710f6f1d-821e-4e5a-afc1-37826841b141]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[898dc871-f5cb-47d5-a7dd-f9ce0785b757]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:03:34 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:03:34 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:03:34 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 23:03:34 user nova-compute[76815]: 
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d69ae4-9c71-4f10-8c64-9ff121f4f10f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41, portal: 172.16.0.220,3260]
Nov 14 23:03:34 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41, portal: 172.16.0.220,3260] successful.
Nov 14 23:03:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4735a0-9912-475a-9b66-1d6dcf17121c]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad60153-3e99-4ec4-9ec3-662f316245ed]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 (non-flash)
Nov 14 23:03:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 (non-flash)
Nov 14 23:03:34 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2edd2c0-bc64-431a-a7c2-d0f1ae5b0a3c]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:34 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIYxjTXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26564343938313233', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564343938313233', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG nova.objects.instance [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:03:35 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:03:35 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:03:35 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:03:35 user nova-compute[76815]:   <serial>14c59301-3763-4f6e-8cdd-95a496011a41</serial>
Nov 14 23:03:35 user nova-compute[76815]: </disk>
Nov 14 23:03:35 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:03:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No VIF found with MAC fa:16:3e:6a:c3:60, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:03:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-30503696-5e60-46cb-b7ca-9d79c0805840 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.202s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:03:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:03:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:03:38 user nova-compute[76815]: INFO nova.compute.manager [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Detaching volume 14c59301-3763-4f6e-8cdd-95a496011a41
Nov 14 23:03:38 user nova-compute[76815]: INFO nova.virt.block_device [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attempting to driver detach volume 14c59301-3763-4f6e-8cdd-95a496011a41 from mountpoint /dev/vdb
Nov 14 23:03:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Attempting to detach device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:03:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:03:38 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:03:38 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:03:38 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:03:38 user nova-compute[76815]:   <serial>14c59301-3763-4f6e-8cdd-95a496011a41</serial>
Nov 14 23:03:38 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:03:38 user nova-compute[76815]: </disk>
Nov 14 23:03:38 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:03:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully detached device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the persistent domain config.
Nov 14 23:03:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:03:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:03:38 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:03:38 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:03:38 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:03:38 user nova-compute[76815]:   <serial>14c59301-3763-4f6e-8cdd-95a496011a41</serial>
Nov 14 23:03:38 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:03:38 user nova-compute[76815]: </disk>
Nov 14 23:03:38 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:03:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:03:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:03:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:03:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:03:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:03:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:03:58 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 230541ab-0012-44bc-84cf-2d975d511a39 is timed out.
Nov 14 23:03:58 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully detached device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the live domain config.
Nov 14 23:03:58 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIYxjTXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:03:58 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f98747a-9c1d-4c0d-8d07-fd91f33c3528]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:03:58 user nova-compute[76815]: No targets found.
Nov 14 23:03:58 user nova-compute[76815]: iSNS:
Nov 14 23:03:58 user nova-compute[76815]: No targets found.
Nov 14 23:03:58 user nova-compute[76815]: STATIC:
Nov 14 23:03:58 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41
Nov 14 23:03:58 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:03:58 user nova-compute[76815]:                 Iface Name: default
Nov 14 23:03:58 user nova-compute[76815]: FIRMWARE:
Nov 14 23:03:58 user nova-compute[76815]: No targets found.
Nov 14 23:03:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:03:58 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:03:58 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[093bd851-d4e4-473f-91da-a0d16ede8099]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[132aecac-f788-4de4-924f-21d2d66b7e5f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 (non-flash)
Nov 14 23:03:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 (non-flash)
Nov 14 23:03:58 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a43fe050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[786d8f17-11d3-4b05-b3bf-09082dc3aeb4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca718ea-a57a-4a91-91e2-1440a476a338]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc5ebc-d1ae-4a7a-b9fa-313dedc28584]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:03:58 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6699d5-3f94-43a9-9671-204a098a1291]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6c39cb-0c47-40ff-9e6a-94e35e5a9b0b]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca7296-2d52-49b6-bb63-78bbe32ee759]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41, portal: 172.16.0.220,3260]
Nov 14 23:03:59 user nova-compute[76815]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41, portal: 172.16.0.220,3260] successful.
Nov 14 23:03:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14c59301-3763-4f6e-8cdd-95a496011a41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e925ce-d417-403f-b03e-a71f8c8d9384]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== disconnect_volume: return (277ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG nova.objects.instance [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:03:59 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-7b1b4f84-1f58-4f20-8c32-220e37024fb9 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.620s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:04:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:04:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:04:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:04:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:04:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:04:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:04:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:04:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:04:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:04:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:04:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:04:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:04:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:04:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:16 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:04:16 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:04:16 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=24.938087463378906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 230541ab-0012-44bc-84cf-2d975d511a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:04:16 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:04:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:19 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:04:19 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:04:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:04:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:04:20 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:04:20 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:04:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:20 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:04:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:04:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:04:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:22 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:23 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:04:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:04:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:04:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:04:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:04:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:27 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG nova.objects.instance [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:04:30 user nova-compute[76815]: INFO nova.compute.manager [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attaching volume 4fbf3b6d-36de-4a7b-a545-91198443b843 to /dev/vdb
Nov 14 23:04:30 user nova-compute[76815]: DEBUG os_brick.utils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1452ef9-2d4b-4700-8376-6f526cb34286]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6354a86e369c\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f99589-2c9e-44d0-adf8-7930824bcdb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c285720-6589-417a-b067-e56a4bcee5bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dc27ce-90cb-47d8-8ef1-46942a8c488a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Running cmd (subprocess): nvme version {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] 'nvme version' failed. Not Retrying. {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] nvme not present on system {{(pid=76815) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 23:04:30 user nova-compute[76815]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 23:04:30 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[db323743-ca95-4d9b-8d62-4873ac2fc4fe]: (4, '') {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=76815) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.lightos [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] LIGHTOS: no hostnqn found. {{(pid=76815) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG os_brick.utils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6354a86e369c', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:04:30 user nova-compute[76815]: DEBUG nova.virt.block_device [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating existing volume attachment record: 17482b52-ae0b-4384-a9d2-0ab5847111c5 {{(pid=76815) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 23:04:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Calling os-brick to attach iSCSI Volume {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSYslcrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:04:35 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:04:35 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:04:35 user nova-compute[76815]: INFO os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18f416d-4551-4c15-b682-dac4824f66e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 23:04:35 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --interface default --op new {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a58aac-2c8b-4de8-a9f3-1b1cbff261a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843] added\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843] added
Nov 14 23:04:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[0059469d-8e57-496d-8a0f-cd2b7530e640]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b26cbf-ece6-4bc6-b635-02983c1bf72e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zSYslcrp {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zSYslcrp" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c98d5c1-240a-4c45-8e1d-96f3d3d36f20]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zSYslcrp'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f96986-71c0-459e-af37-82e341a52db7]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81c4987-8672-4d17-82da-583407c90110]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:04:35 user nova-compute[76815]:  {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 23:04:35 user nova-compute[76815]:  {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:04:35 user nova-compute[76815]: WARNING os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 23:04:35 user nova-compute[76815]: 
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --login {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[372a12e6-daab-4e86-afc4-7c95488643e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843, portal: 172.16.0.220,3260]
Nov 14 23:04:35 user nova-compute[76815]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843, portal: 172.16.0.220,3260] successful.
Nov 14 23:04:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ca93c5-cce6-40e3-af47-8be88ca66b65]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[db729be6-28aa-41cc-827a-d9c25692ade9]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 (non-flash)
Nov 14 23:04:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 (non-flash)
Nov 14 23:04:35 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Connected to 172.16.0.220:3260 {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=76815) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=76815) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[4655437c-18b4-4c0b-aec3-bf8941b10027]: (4, ('- - 0', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:35 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=76815) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSYslcrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=76815) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26439383133363865', 'path': '/dev/sdb'} {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439383133363865', 'path': '/dev/sdb'} {{(pid=76815) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG nova.objects.instance [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 23:04:36 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:04:36 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:04:36 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:04:36 user nova-compute[76815]:   <serial>4fbf3b6d-36de-4a7b-a545-91198443b843</serial>
Nov 14 23:04:36 user nova-compute[76815]: </disk>
Nov 14 23:04:36 user nova-compute[76815]:  {{(pid=76815) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No BDM found with device name vda, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=76815) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] No VIF found with MAC fa:16:3e:6a:c3:60, not building metadata {{(pid=76815) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 23:04:36 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-b22f5cb2-5eca-472b-84f3-eda44feeda73 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.308s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:04:38 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 23:04:38 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] There are 0 instances to clean {{(pid=76815) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 23:04:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:04:38 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:04:38 user nova-compute[76815]: INFO nova.compute.manager [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Detaching volume 4fbf3b6d-36de-4a7b-a545-91198443b843
Nov 14 23:04:38 user nova-compute[76815]: INFO nova.virt.block_device [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Attempting to driver detach volume 4fbf3b6d-36de-4a7b-a545-91198443b843 from mountpoint /dev/vdb
Nov 14 23:04:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Attempting to detach device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the persistent domain config. {{(pid=76815) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 23:04:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:04:38 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:04:38 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:04:38 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:04:38 user nova-compute[76815]:   <serial>4fbf3b6d-36de-4a7b-a545-91198443b843</serial>
Nov 14 23:04:38 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:04:38 user nova-compute[76815]: </disk>
Nov 14 23:04:38 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:04:38 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully detached device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the persistent domain config.
Nov 14 23:04:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the live domain config. {{(pid=76815) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 23:04:38 user nova-compute[76815]: DEBUG nova.virt.libvirt.guest [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 23:04:38 user nova-compute[76815]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 23:04:38 user nova-compute[76815]:   <source dev="/dev/sdb"/>
Nov 14 23:04:38 user nova-compute[76815]:   <target dev="vdb" bus="virtio"/>
Nov 14 23:04:38 user nova-compute[76815]:   <serial>4fbf3b6d-36de-4a7b-a545-91198443b843</serial>
Nov 14 23:04:38 user nova-compute[76815]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 23:04:38 user nova-compute[76815]: </disk>
Nov 14 23:04:38 user nova-compute[76815]:  {{(pid=76815) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 23:04:39 user nova-compute[76815]: DEBUG nova.virt.libvirt.driver [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 23:04:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:43 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:45 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:50 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:55 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:04:57 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Cleaning up deleted instances with incomplete migration  {{(pid=76815) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 23:04:59 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 230541ab-0012-44bc-84cf-2d975d511a39 is timed out.
Nov 14 23:04:59 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully detached device vdb from instance 230541ab-0012-44bc-84cf-2d975d511a39 from the live domain config.
Nov 14 23:04:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] calling os-brick to detach iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f74c85dd6f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zSYslcrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 23:04:59 user nova-compute[76815]: WARNING os_brick.initiator.connectors.base [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[a130af9a-f040-4ce0-a0bd-75b4272aa677]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 23:04:59 user nova-compute[76815]: No targets found.
Nov 14 23:04:59 user nova-compute[76815]: iSNS:
Nov 14 23:04:59 user nova-compute[76815]: No targets found.
Nov 14 23:04:59 user nova-compute[76815]: STATIC:
Nov 14 23:04:59 user nova-compute[76815]: Target: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843
Nov 14 23:04:59 user nova-compute[76815]:         Portal: 172.16.0.220:3260,-1
Nov 14 23:04:59 user nova-compute[76815]:                 Iface Name: default
Nov 14 23:04:59 user nova-compute[76815]: FIRMWARE:
Nov 14 23:04:59 user nova-compute[76815]: No targets found.
Nov 14 23:04:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 23:04:59 user nova-compute[76815]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 23:04:59 user nova-compute[76815]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=76815) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843', 0)] {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[71831344-822f-4ed3-b1f0-3f4525ed19f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e9909a-ee06-4837-a0fd-fa75a29c2d9b]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 (non-flash)\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 (non-flash)
Nov 14 23:04:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 (non-flash)
Nov 14 23:04:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f74a4586200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843'): ({'sdb'}, set())}) {{(pid=76815) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Removing single pathed devices sdb {{(pid=76815) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8dcb7a-a2b9-4930-a797-53dfe42143ca]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[6924dab5-5025-479c-8c69-f3530cb5f387]: (4, ('ok\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Flushing IO for device /dev/sdb {{(pid=76815) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[5432288c-c2b1-4bf1-b4e8-ac08e8880a05]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=76815) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff31836-1194-4440-b227-1c136644df95]: (4, ('1', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.linuxscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] SCSI volumes sdb have been removed. {{(pid=76815) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843')] {{(pid=76815) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24a4e55-e9e9-4787-b1ba-7d8e3732ae31]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --logout {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f1a0d6-ed14-436c-9b62-507bc1621cb6]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843, portal: 172.16.0.220,3260]
Nov 14 23:04:59 user nova-compute[76815]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843, portal: 172.16.0.220,3260] successful.
Nov 14 23:04:59 user nova-compute[76815]:  stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op delete {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fbf3b6d-36de-4a7b-a545-91198443b843 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d99ec88-3a5a-4781-931c-b354edf91e0e]: (4, ('', '')) {{(pid=86648) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=76815) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.base [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] <== disconnect_volume: return (296ms) None {{(pid=76815) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 23:04:59 user nova-compute[76815]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Disconnected iSCSI Volume {{(pid=76815) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 23:05:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:05:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:00 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:00 user nova-compute[76815]: DEBUG nova.objects.instance [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'flavor' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:05:00 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-4c581e26-ef36-4515-9b0f-ce2559954a29 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.588s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:05:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:05:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:05 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:10 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:15 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_concurrency.processutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=76815) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 23:05:18 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:05:18 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:05:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=8988MB free_disk=24.929359436035156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Instance 230541ab-0012-44bc-84cf-2d975d511a39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=76815) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:05:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:05:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing inventories for resource provider 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 23:05:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating ProviderTree inventory for provider 796094e8-bd05-4653-ba99-df40d0b26085 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 23:05:19 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Updating inventory in ProviderTree for provider 796094e8-bd05-4653-ba99-df40d0b26085 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 23:05:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing aggregate associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, aggregates: None {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 23:05:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Refreshing trait associations for resource provider 796094e8-bd05-4653-ba99-df40d0b26085, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=76815) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 23:05:19 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:05:19 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:05:19 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:05:19 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquired lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Forcefully refreshing network info cache for instance {{(pid=76815) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG nova.objects.instance [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lazy-loading 'info_cache' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG nova.network.neutron [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [{"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Releasing lock "refresh_cache-230541ab-0012-44bc-84cf-2d975d511a39" {{(pid=76815) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updated the network info_cache for instance {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:20 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:23 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:24 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:24 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:05:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:05:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:25 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:29 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:30 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:32 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_power_states {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:32 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Triggering sync for uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 23:05:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:05:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:05:32 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:05:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:05:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:05:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:05:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:40 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:05:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:05:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:05:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:05:41 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:05:41 user nova-compute[76815]: INFO nova.compute.manager [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Terminating instance
Nov 14 23:05:41 user nova-compute[76815]: DEBUG nova.compute.manager [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Start destroying the instance on the hypervisor. {{(pid=76815) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 23:05:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:41 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-affbffe2-a58d-4470-bfce-468139e0b1a6 req-17402401-12de-4f02-81f5-61674ccb65db service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received event network-vif-unplugged-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-affbffe2-a58d-4470-bfce-468139e0b1a6 req-17402401-12de-4f02-81f5-61674ccb65db service nova] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-affbffe2-a58d-4470-bfce-468139e0b1a6 req-17402401-12de-4f02-81f5-61674ccb65db service nova] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-affbffe2-a58d-4470-bfce-468139e0b1a6 req-17402401-12de-4f02-81f5-61674ccb65db service nova] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-affbffe2-a58d-4470-bfce-468139e0b1a6 req-17402401-12de-4f02-81f5-61674ccb65db service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] No waiting events found dispatching network-vif-unplugged-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG nova.compute.manager [req-affbffe2-a58d-4470-bfce-468139e0b1a6 req-17402401-12de-4f02-81f5-61674ccb65db service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received event network-vif-unplugged-7dc78aba-9b2e-493b-8062-0791d3df96df for instance with task_state deleting. {{(pid=76815) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:42 user nova-compute[76815]: INFO nova.virt.libvirt.driver [-] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Instance destroyed successfully.
Nov 14 23:05:42 user nova-compute[76815]: DEBUG nova.objects.instance [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lazy-loading 'resources' on Instance uuid 230541ab-0012-44bc-84cf-2d975d511a39 {{(pid=76815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG nova.virt.libvirt.vif [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T22:59:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1393322600',display_name='tempest-SnapshotDataIntegrityTests-server-1393322600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1393322600',id=53,image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXnNzdvMOhTakylL7LhgczsDN5RpakKsd2zVWDv/XqFrQDuly1sXrSv2KSxjlwgX0JGJjjmDL8qD9+jMIwkBoJJdUyn10ftPPCmE58wDS3D0Nrbh9OpVu0syNImsLgCcA==',key_name='tempest-keypair-1150691899',keypairs=<?>,launch_index=0,launched_at=2023-11-14T22:59:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='895e509457844d639d43c72d2adbbc51',ramdisk_id='',reservation_id='r-h7kgrx04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='17f0b7df-7e07-48b3-bb67-6524172efa0a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1549100178',owner_user_name='tempest-SnapshotDataIntegrityTests-1549100178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T22:59:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95922dcd8c254da18864a1d0e498c1eb',uuid=230541ab-0012-44bc-84cf-2d975d511a39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Converting VIF {"id": "7dc78aba-9b2e-493b-8062-0791d3df96df", "address": "fa:16:3e:6a:c3:60", "network": {"id": "0ac2ca09-e81e-4ff3-9145-a4ea4fc04276", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1982283003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "895e509457844d639d43c72d2adbbc51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dc78aba-9b", "ovs_interfaceid": "7dc78aba-9b2e-493b-8062-0791d3df96df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG nova.network.os_vif_util [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c3:60,bridge_name='br-int',has_traffic_filtering=True,id=7dc78aba-9b2e-493b-8062-0791d3df96df,network=Network(0ac2ca09-e81e-4ff3-9145-a4ea4fc04276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc78aba-9b') {{(pid=76815) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG os_vif [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c3:60,bridge_name='br-int',has_traffic_filtering=True,id=7dc78aba-9b2e-493b-8062-0791d3df96df,network=Network(0ac2ca09-e81e-4ff3-9145-a4ea4fc04276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc78aba-9b') {{(pid=76815) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dc78aba-9b, bridge=br-int, if_exists=True) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50ae4f1d-cf8a-4409-9760-a8220fdbdf2f) {{(pid=76815) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:42 user nova-compute[76815]: INFO os_vif [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c3:60,bridge_name='br-int',has_traffic_filtering=True,id=7dc78aba-9b2e-493b-8062-0791d3df96df,network=Network(0ac2ca09-e81e-4ff3-9145-a4ea4fc04276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dc78aba-9b')
Nov 14 23:05:42 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Deleting instance files /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39_del
Nov 14 23:05:42 user nova-compute[76815]: INFO nova.virt.libvirt.driver [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Deletion of /opt/stack/data/nova/instances/230541ab-0012-44bc-84cf-2d975d511a39_del complete
Nov 14 23:05:42 user nova-compute[76815]: INFO nova.compute.manager [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 23:05:42 user nova-compute[76815]: DEBUG oslo.service.loopingcall [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=76815) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG nova.compute.manager [-] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Deallocating network for instance {{(pid=76815) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 23:05:42 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] deallocate_for_instance() {{(pid=76815) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 23:05:43 user nova-compute[76815]: DEBUG nova.network.neutron [-] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Updating instance_info_cache with network_info: [] {{(pid=76815) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 23:05:43 user nova-compute[76815]: INFO nova.compute.manager [-] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Took 1.13 seconds to deallocate network for instance.
Nov 14 23:05:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:05:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:05:43 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:05:43 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:05:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:05:43 user nova-compute[76815]: INFO nova.scheduler.client.report [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Deleted allocations for instance 230541ab-0012-44bc-84cf-2d975d511a39
Nov 14 23:05:43 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-09a6c149-d947-467e-97bd-1d8ae9b90de1 tempest-SnapshotDataIntegrityTests-1549100178 tempest-SnapshotDataIntegrityTests-1549100178-project-member] Lock "230541ab-0012-44bc-84cf-2d975d511a39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.293s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:05:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-79af202c-2514-4751-8b6c-911dbfcf17d1 req-952e7f86-fcbc-423f-af9e-5828db91b867 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received event network-vif-plugged-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:05:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79af202c-2514-4751-8b6c-911dbfcf17d1 req-952e7f86-fcbc-423f-af9e-5828db91b867 service nova] Acquiring lock "230541ab-0012-44bc-84cf-2d975d511a39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:05:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79af202c-2514-4751-8b6c-911dbfcf17d1 req-952e7f86-fcbc-423f-af9e-5828db91b867 service nova] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:05:44 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [req-79af202c-2514-4751-8b6c-911dbfcf17d1 req-952e7f86-fcbc-423f-af9e-5828db91b867 service nova] Lock "230541ab-0012-44bc-84cf-2d975d511a39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:05:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-79af202c-2514-4751-8b6c-911dbfcf17d1 req-952e7f86-fcbc-423f-af9e-5828db91b867 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] No waiting events found dispatching network-vif-plugged-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 23:05:44 user nova-compute[76815]: WARNING nova.compute.manager [req-79af202c-2514-4751-8b6c-911dbfcf17d1 req-952e7f86-fcbc-423f-af9e-5828db91b867 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received unexpected event network-vif-plugged-7dc78aba-9b2e-493b-8062-0791d3df96df for instance with vm_state deleted and task_state None.
Nov 14 23:05:44 user nova-compute[76815]: DEBUG nova.compute.manager [req-79af202c-2514-4751-8b6c-911dbfcf17d1 req-952e7f86-fcbc-423f-af9e-5828db91b867 service nova] [instance: 230541ab-0012-44bc-84cf-2d975d511a39] Received event network-vif-deleted-7dc78aba-9b2e-493b-8062-0791d3df96df {{(pid=76815) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 23:05:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:05:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:05:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:06:02 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:06:07 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:06:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:06:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:06:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:06:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:06:12 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:17 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager.update_available_resource {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Auditing locally available compute resources for user (node: user) {{(pid=76815) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 23:06:18 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:06:18 user nova-compute[76815]: WARNING nova.virt.libvirt.driver [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 23:06:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Hypervisor/Node resource view: name=user free_ram=9124MB free_disk=24.95644760131836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=76815) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=76815) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG nova.compute.provider_tree [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed in ProviderTree for provider: 796094e8-bd05-4653-ba99-df40d0b26085 {{(pid=76815) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG nova.scheduler.client.report [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Inventory has not changed for provider 796094e8-bd05-4653-ba99-df40d0b26085 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=76815) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG nova.compute.resource_tracker [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Compute_service record updated for user:user {{(pid=76815) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 23:06:18 user nova-compute[76815]: DEBUG oslo_concurrency.lockutils [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=76815) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 23:06:21 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:21 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:21 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Starting heal instance info cache {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 23:06:21 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Rebuilding the list of instances to heal {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 23:06:21 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Didn't find any instances for network info cache update. {{(pid=76815) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 23:06:22 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:22 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:06:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:25 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:26 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:26 user nova-compute[76815]: DEBUG nova.compute.manager [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=76815) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 23:06:27 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:06:30 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:32 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:06:33 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:33 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:35 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:37 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:38 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:42 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 23:06:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=76815) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 23:06:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:06:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=76815) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 23:06:47 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:52 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 23:06:57 user nova-compute[76815]: DEBUG oslo_service.periodic_task [None req-2abc77a8-a404-47ec-9670-6a562052ae3c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=76815) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 23:06:57 user nova-compute[76815]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=76815) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}